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ABSTRACT 



A printed object, such as an item of postal mail, a book, 
printed advertising, a business card, product packaging, etc., 
is steganographically encoded with plural-bit data. When 
such an object is presented to an optical sensor, the plural-bit 
data is decoded and used to establish a link to an internet 
address corresponding to that object. 
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LINKING OF COMPUTERS BASED ON disclosure concentrates on objects which have some form of 

STEGANOGRAPHICALLY EMBEDDED digital message attached thereto, some aspects of the inven- 

DIGITAL DATA tion may apply to objects which have no such thing, where 

the prior arts of pattern recognition and gestural input can be 

RELATED APPLICATION DATA 5 borrowed in combination with this invention to effect yet a 

This application is a continuation of Ser. No. 09/342,689, Droa der array of applications, 

filed Jun. 29, 1999 now U.S. Pat. No. 6,311,214, which is a "Bedoop." The sound that a refrigerator might make, 

continuation-in-part of application Ser. No. 09/130,624, outfitted with a simple camera/processor unit/net 

filed Aug. 6, 1998 now U.S. Pat. No. 6,324,573, which is a connection, as the ten year old holds up the empty milk 

continuation of application Ser. No. 08/508,083 (now U.S. 10 c , artoa and a P in g g° cs out t0 thc local P™** storc ' addin g 

Pat. No. 5,841,978) filed Jul. 27, 1995. Application Ser. No. mc llcm t0 an accumulating delivery list. The sound that 

09/342,689 is also a continuation-in part of copending mi S ht be hcard echoia S ovcr and over inside Iotcraet caf6s 

application Ser. No. 09/314,648, filed May 19, 1999. Appli- as heretofore computerphobes take their first skeptical steps 

cation Ser. No. 09/342,689 is also a continuation-in-part of 1C onto thc wo ( rld wide web - ^ ^ nd heard at thc fast food 

copending provisional application No. 60/134,782, also filed 15 countcr as thc rc P eat customer holds up their sandwich card 

May 19 1999 ticking off their latest meal, hoping for the sirens to go off 

for a S500 prize given to the lucky customer of the week, 

FIELD OF THE INVENTION Blue sky scenarios abound. 

„ ... • , • /. i_ This invention is therefore about powerful new user 

The presen invention relates optical user interfaces that 20 MeAces to optica i input . These new 

sense digitally-encoded obiects. The invention further • * _r 5 j ■ * *u j ,,- 4 . 4 

& J . J . . . . - , user interfaces extend into the everyday world in ways that 

relates to systems using such optical interfaces to control „ , , , , %J <n u- * 

j F , r 4 _ . 4 a mouse and keyboard never could. By enabling everyday 

computers, and to navigate over or act as portals on net- . . * *u • j j «. *■ / 

/ ' 6 r obiects to communicate their identities and functions to 
works 

ever-attendant devices, not only will the world wide web be 

BACKGROUND AND SUMMARY OF THE 25 given an eatu * elv new dimension, but basic home and office 

INVENTION computing may be in store for some fundamental advances 

as well. 

"Bedoop." That might be the sound that someone might These, and a great many other features of the present 

hear as they lazily place a magazine advertisement in front invention will be more readily apparent from the following 

of their desktop camera. Magically, the marketing and sales 30 detailed description, which proceeds with reference to the 

web site associated with the ad is displayed on their com- accompanying drawings, 
puter. More information? Want to buy now? Look at the full 

product line? No problem. BRIEF DESCRIPTION OF THE DRAWINGS 

"Bedoop" That might be the same sound when that same __. « ■ 1 1 , j. . ii- , j- . 

someone places their credit card in front of their desktop 35 JIIq! invention ^ ara s ' 30wm 8 one embodiment of the 

camera. Instantly, the product displayed on the web page is ^ 1 1 

purchased. Behind the scenes, a secure purchase link is FIG - 2 15 another block diagram showing an embodiment 

initiated, transmitting alt requisite information to the vendor. of tne present invention. 

Twist the credit card clockwise and the purchaser chooses An _ m „ 

overnight delivery. 40 DETAILED DESCRIPTION 

So goes an exemplary embodiment of the invention Basically, the technology detailed in this disclosure may 

further described in this application. Though this example is be regarded as enhanced systems by which users can interact 

rather specific, it nevertheless alludes to an indescribably with computer-based devices. Their simple nature, and 

vast array of applications possible when a digital camera or 45 adaptability for use with everyday objects (e.g., milk 

other optical sensing device is turned into a general purpose cartons), makes the disclosed technology well suited for 

user interface device with an intuitive power that very well countless applications. 

might rival the mouse and the keyboard. Due t0 tne great range and variety of subject matter 

The centerpiece of the invention is that an object or paper detailed in this disclosure, an orderly presentation is difficult 

product so-scanned contains digital information that can be 50 to achieve. As will be evident, many of the topical sections 

quickly read and acted upon by an appropriately configured presented below are both founded on, and foundational to, 

device, computer or appliance. The preferred embodiment other sections. For want of a better rationale, the sections are 

envisions that this digital information is aesthetically hidden presented below in a more or less random order. It should be 

on objects. These objects have been previously and pro- recognized that both the general principles and the particular 

actively marked with the digital information, using any of 55 details from each section find application in other sections as 

the broad ranges of printing and processing techniques we ll. To prevent the length of this disclosure from balloon- 

which are available on the market and which are widely ing 0 ut of control, the various permutations and combina- 

described in the open literature and patent literature sur- tions of the features of the different sections are not ex haus- 

rounding digital watermarking. tively detailed. The inventors intend to explicitly teach such 

Be this as it may, though the invention concentrates on flat 60 combinations/permutations, but practicality requires that the 

object applications wherein the digital information is often detailed synthesis be left to those who ultimately implement 

imperceptibly integrated into the object, it is certainly not systems in accordance with such teachings, 

meant to be so limited. Objects can be three dimensional in Basic Principles — Refrigerators and Clutter 

nature and the information more visually overt and/or pre- Referring to FIG. 1, a basic embodiment 10 of the present 

existing (i.e., not "pro -actively" embedded, or not even be 65 invention includes an optical sensor 12, a computer 14, and 

"digital," per se). Different implementation considerations a network connection 16 to the internet 18. The illustrated 

attach to these variants. Likewise, though the bulk of this optical sensor 12 is a digital camera having a resolution of 
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320 by 200 pixels (color or black and white) that stares out, 
grabbing frames of image data five times per second and 
storing same in one or more frame buffers. These frames of 
image data are analyzed by a computer 14 for the presence 
of Bedoop data. (Essentially, Bedoop data is any form of 
digital data encoding recognized by the system data 
which, in many embodiments, initiates some action.) Once 
detected, the system responds in accordance with the 
detected Bedoop data (e.g., by initiating some local action, 
or by communication with a remote computer, such as over 
the internet, via an online service such as AOL, or using 
point-to-point dial-up communications, as with a bulletin 
board system. 

Consider the milk carton example. The artwork on a milk 
carton can be adapted to convey Bedoop data. In the 
preferred embodiment, the Bedoop data is steganographi- 
cally encoded (e.g., digitally watermarked) on the carton. 
Numerous digital watermarking techniques are known — all 
of which convey data in a hidden form (i.e., on human 
inspection, it is not apparent that digitally encoded data is 
present). Exemplary techniques operate by slightly changing 20 
the luminance, or contours, of selected points on artwork or 
text printed on the carton, or splatter tiny droplets of ink on 
the carton in a seemingly random pattern. Each of these 
techniques has the effect of changing the local luminance at 
areas across the carton — luminance changes that can be 2 $ 
detected by the computer 14 and decoded to extract the 
encoded digital data. In the case of a milk carton, the data 
may serve to identify the object as, e.g., a half gallon carton 
of Alpenrose brand skim milk. 

The FIG. 1 apparatus can be integrated into the door of a 3Q 
refrigerator and used to compile a shopping list. Milk 
cartons, and other Bedoop-encoded packaging 20, can be 
held up the optical sensor. When the computer 14 detects the 
presence of Bedoop data and successfully decodes same, it 
issues a confirmation tone ("be-doop") from a speaker or 
other audio transducer 22. The ^computer then adds data 
identifying the just -detected object to a grocery list. This list 
can be maintained locally (in disk storage, non-volatile 
RAM 24, or the like in the refrigerator, or elsewhere in the 
home), or remotely (e.g., at a server located at a user- 
selected grocery, or elsewhere). In either event, the list is 
desirably displayed on a display in the user's home (e.g., an 
LCD screen 26 built into the front of the appliance). Con- 
ventional user interface techniques can be employed per- 
mitting the user to scroll through the displayed list, delete 
items as desired, etc. 

Periodically, the listed groceries can be purchased and the 
list cleared. In one embodiment, the list is printed (either at 
the home or at the grocery), and the user walks the grocery 
aisles and purchases same in the conventional manner. In 
another embodiment, the grocer pulls the listed items from 
the shelves (in response to a user request conveyed by the 
internet or telephone, or by a gesture as hereafter detailed). 
Once the list has been pulled, the grocer can alert the user 
that the groceries are available for pickup (again, e.g., by 
internet or telephone message), or the grocer can simply 
deliver the groceries directly to the user's home. Naturally, 
on-line payment mechanisms can be employed if desired. 

Consider a wholly unrelated Bedoop application. An 
Excel spreadsheet is printed onto paper, and the paper 
becomes buried in a stack of clutter on an office worker's 
desk. Months later the spreadsheet again becomes relevant 
and is dug out of the stack. Changes need to be made to the 
data, but the file name has long-since been forgotten. The 
worker simply holds the dug-out page in front of a camera 
associated with the desktop computer. A moment later, the 
electronic version of the file appears on the worker's com- 
puter display. 
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When the page was originally printed, tiny droplets of ink 
or toner were distributed across the paper in a pattern so light 
as to be essentially un-noticeable, but which steganographi- 
cally encoded the page with a plural-bit binary number (e.g., 
64 bits). A database (e.g., maintained by the operating 
system, the Excel program, the printer driver, etc.) stored 
part of this number (e.g., 24 bits, termed a Univeral Identifier 
or UID) in association with the path and file name at which 
the electronic version of the file was stored, the page number 
within the document, and other useful information (e.g., 
author of the file, creation date, etc.). 

The steganographic encoding of the document, and the 
updating of the database, can be performed by the software 
application (e.g., Excel). This option can be selected once by 
the user and applied thereafter to all printed documents (e.g., 
by a user selection on an "Options" drop-down menu), or 
can be presented to the user as part of the Print dialog 
window and selected (or not) for each print job. 

When such a printed page is later presented to the camera, 
the computer automatically detects the presence of the 
encoded data on the page, decodes same, consults the 
database to identify the file name/location/page correspond- 
ing to the UID data, and opens the identified file to the 
correct page (e.g., after launching Excel). This application is 
one of many "paper as portal" applications of the Bedoop 
technology. 

The foregoing are but two of myriad applications of the 
technology detailed herein. In the following discussion a 
great many other applications are disclosed (some 
groundbreaking, a few gimmicky). However, regardless of 
the length of the specification, it is possible only to begin to 
explore a few of the vast ramifications of this technology. 

A few more details on the basic embodiments described 
above may be helpful before delving into other applications. 
Optics 

For any system to decode steganographically encoded 
data from an object, the image of the object must be 
adequately focused on the digital camera's CCD (or other) 
sensor. In a low cost embodiment, the camera has a fixed 
nominal focal length, e.g., in the range of 6-24 inches 
(greater or lesser lengths can of course be used). Since the 
camera is continuously grabbing and analyzing frames of 
data, the user can move the object towards- or away-from 
the sensor until the decoder succeeds in decoding the 
steganographically encoded data and issues a confirming 
"Bedoop" audio signal. 

In more elaborate embodiments, known auto-focusing 
technology can be employed. 

In still other embodiments, the camera (or other sensor) 
can be equipped with one or more auxiliary fixed -focus 
lenses that can be selectively used, depending on the par- 
ticular application. Some such embodiments have a first 
fixed focused lens that always overlies the sensor, with 
which one or more auxiliary lenses can be optically cas- 
caded (e.g., by hinge or slide arrangements). Such arrange- 
ments are desirable, e.g., when a camera is not a dedicated 
Bedoop sensor but also performs other imaging tasks. When 
the camera is to be used for Bedoop, the auxiliary lens is 
positioned (e.g., flipped into) place, changing the focal 
length of the first lens (which may by unsuitably long for 
Bedoop purposes, such as infinity) to an appropriate Bedoop 
imaging range (such as one foot). 

Other lens-switching embodiments do not employ a fixed 
lens that always overlies the sensor, but instead employ two 
or more lenses that can be moved into place over the sensor. 
By selecting different lenses, focal lengths such as infinity, 
six feet, and one foot can be selected. 
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In all such arrangements, it is desirable (but not essential) fiducials), or serving another purpose as well (e.g. lines of 

that the steganographically -encoded portion of the object text), to discern orientation. Edge-detection algorithms can 

being imaged fills a substantial part of the image frame. The also be employed to deduce the orientation of the object by 

object can be of various sizes, e.g., an 10 by 12 inch front reference to its edges. 

panel of a cereal box, or a proof of purchase certificate that 5 Some embodiments filter the image data at some point in 

is just one inch square. To meet this requirement, small me process to aid in ultimate Bedoop data extraction. One 

objects will obviously need to be placed closer to the camera use of such filtering is to mitigate image data artifacts due to 

than large objects. The optics of the system can be designed, me Particular optical sensor. For example, CCD arrays have 

e.g., by selection of suitable aperture sizing and auxiliary regularly-spaced sensors that sampk the optical image at 

lighting (if needed), to properly image objects of various 10 "f 0 ™ 1 ? s P a f ced discrete points. This discrete sampling 

sLs within a ranee of focal distances cffeclS a traQsformatl0n of thc ima e e data, lcadm g t0 certain 

sizes wimin a range oi local distances j^gg artifacts. An appropriately configured filter can miti- 

Some embodiments avoid issues of focal distances and ^ ^ Qf ^ 

identifying the intended object by constraining the size of 0n some arrangementS) the step of determining the ori- 

the object and/or its placement. An example is a business e ntation can be omitted. Business card readers, for example, 

card reader that is designed for the sole task of imaging is produce data that is reliably free of artifacts and is of known 

business cards. Various such devices are known. sca i Ci 0 r the encoding of the Bedoop data can be effected in 

Decoding/Encoding such a way that renders it relatively immune to certain 

The analysis of the image data can be accomplished in distortion mechanisms. For example, while the presently- 
various known ways. Presently, most steganographic decod- preferred encoding arrangement operates on a 2D grid basis, 
ing relies on general purpose microprocessors that are 20 with rows and columns of data points, the encoding can 
programmed by suitable software instructions to perform the alternatively be done on another basis (e.g., a rotationally- 
necessary analysis. Other arrangements, such as using dedi- symmetric form of encoding, such as a 2D bar-code, so that 
cated hardware, reprogrammable gate arrays, or other rotational state of the image data can be ignored). In still 
techniques, can of course be used. other embodiments, the orientation-determining step can be 

The steganographic decoding process may entail three 25 omitted because the decoding can readily proceed without 

steps. In the first, the object is located. In the second, the this information. For example decoding which relies on the 

object's orientation is discerned. In the third, the Bedoop Fourier-Mellin transform produces data in which scale and 

data is extracted from the image data corresponding to the rotation can be ignored.) 

Bedoop object. Once the orientation of the object is discerned, the image 
The first step, object location, can be assisted by various 30 data may be virtually re-registered, effectively mapping it to 
clues. One is the placement of the object; typically the center another perspective (e.g., onto a rectilinear image plane), 
of the image field will be a point on the object. The This mapping can employ known image processing tech- 
surrounding data can then be analyzed to try and discern the niques to compensate, e.g., for rotation state, scale state, 
object's boundaries. differential scale state, and X-Y offset, of the original 
Another location technique is slight movement. Although 35 Bedoop image data. The resulting frame of data may then be 
the user will typically try to hold the object still, there will more readily processed to extract the steganographically- 
usually be some jitter of the Bedoop object within the image encoded Bedoop data. 

frame (e.g., a few pixels back and forth). Background visual In the preferred embodiment, after the image data is 

clutter, in contrast, will typically be stationary. Such move- remapped into rectilinear planar form, subliminal graticule 

ment may thus be sensed and used to identify the Bedoop 40 data is sensed that identifies the locations within the image 

object from within the image data. data where the binary data is encoded. Desirably, the binary 

Still another object- location clue is object shape. Many data is redundantly encoded, e.g., in 8x8 patch blocks. Each 

Bedoop objects are rectangular in shape (or trapezoidal as patch comprises one or more pixels. (The patches are 

viewed by the camera). Straight edge boundaries can thus be typically square, and thus contain 1, 4, 9, or 16, etc. pixels.) 

used to define an area of likely Bedoop data. 45 The nominal luminance of each patch before encoding (e.g., 

Color is a further object identification clue that may be artwork pre-existing on the object) is slightly increased or 

useful in some contexts. decreased to encode a binary "1" or "0." The change is slight 

Yet another object location clue is spatial frequency. In enough to be generally imperceptible to human observers, 

imaging systems with well defined focal zones, undesired yet statistically detectable from the image data — especially 

visual clutter may be at focal distances that results in 50 if several such blocks are available for analysis. Preferably, 

blurring. The Bedoop object, in contrast, will be in focus and the degree of change is adapted to the character of the 

may be characterized by fine detail. Analyzing the image underlying image, with relatively greater changes being 

data for the high frequencies associated with fine detail can made in regions where the human eye is less likely to notice 

be used to distinguish the intended object from others. them. Each block thus encoded can convey 64 bits of data. 

Characteristic markings on the object (as discussed below 55 The encoding of such blocks in tiled fashion across the 

in connection with determining object orientation), can also object permits the data to be conveyed in robust fashion, 

be sensed and used in locating the object. Much of the time, of course, the Bedoop sensor is staring 

Once the Bedoop object has been located within the out and grabbing image frames that have no Bedoop data, 

image data, masking can be applied (if desired) to eliminate Desirably, the detection process includes one or more checks 

image data not corresponding to the intended object. 60 to assure that Bedoop data is not wrongly discerned from 

The second step in the decoding process — determining non-Bedoop image data. Various techniques can be 

orientation of the Bedoop data — can likewise be discerned employed to validate the decoded data, e.g., error detecting 

by reference to visual clues. For example, some objects codes can be included in the Bedoop payload and checked 

include subliminal graticule data, or other calibration data, to confirm correspondence with the other Bedoop payload. 

steganographically encoded with the Bedoop data to aid in 65 Likewise, the system can confirm that the same Bedoop data 

determining orientation. Others can employ overt markings, is present in different tiled excerpts within the image data, 

either placed for that sole purpose (e.g. reference lines or etc. 
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(Details of the preferred encoding techniques are further 
detailed in co-pending application Ser. No. 09/293,601, filed 
Apr. 15, 1999, now U.S. Pat. No. 6,427,020, entitled METH- 
ODS AND DEVICES FOR RECOGNIZING BAN- 
KNOTES AND RESPONDING ACCORDINGLY, Ser. No. 
09/127,502, filed Jul. 31, 1998, and U.S. Pat. No. 5,862, 
260.) 

Data Structures, Formats, Protocols, and Infrastructures 

In an exemplary system, the Bedoop data payload is 64 
bits. This payload is divided into three fields CLASS (12 
bits), DNS (24 bits) and UID (24 bits). (Other payload 
lengths, fields, and divisions, are of course possible, as is the 
provision of error-checking or error-correcting bits.) 

Within the above-described eight patch-by-eight patch 
data block, the bits are ordered row by row, starting with the 
upper left patch. The first 12 bits are the CLASS ID, 
followed by 24 bits of DNS data followed by 24 bits of UID 
data. (In other embodiments, the placement of bits compris- 
ing these three fields can be scrambled throughout the 
block.) 

Briefly, the CLASS ID is the most rudimentary division of 
Bedoop data, and may be analogized, in the familiar internet 
taxonomy, limited number of top level domains (e.g., .com, 
.net, .org, .mil, .edu, .jp, .de, .uk, etc.). It is basically an 
indicator of object type. The DNS ID is an intermediate level 
of data, and may be analogized to internet server addresses 
(e.g., biz.yahoo, interactive.wsj, etc.) The UID is the finest 
level of granularity, and can roughly be analogized to 
internet pages on a particular server (e.g., edition/current/ 
summaries/front. htm, daily/home/default. hts, etc.). 

Generally speaking, the CLASS ID and DNS ID, 
collectively, indicate to the system what sort of Bedoop data 
is on the object. In the case of Bedoop systems that rely on 
remote servers, the CLASS and DNS IDs are used in 
identifying the server computer that will respond to the 
Bedoop data. The UID determines precisely what response 
should be provided. 

In the case of a refrigerator Bedoop system, what happens 
if an object with an unfamiliar CLASS/DNS ID data is 
encountered? The system can be programmed not to respond 
at all, or to respond with a raspberry-like sound (or other 
feedback) indicating "I see a Bedoop object but don't know 
what to do with it." 

Most systems will be able to respond to several classes of 
Bedoop objects. Simple software-based systems can com- 
pare the CLASS/DNS ID (and optionally the UID) to fixed 
values, and can branch program execution to corresponding 
subroutines. Likewise, hardware-based systems can activate 
different circuitry depending on the detected CLASS/DNS 
ID. 

In the case of a computer equipped with a Bedoop input 
device (e.g., a Sony VAIO PictureBook laptop with built-in 
camera), the operating system's registry database can be 
employed to associate different application programs with 
different CLASS/DNS IDs (just as the .XLS and .DOC file 
extensions are commonly associated by existing operating 
system registries to invoke Microsoft Excel and Word soft- 
ware applications, respectively). When a new Bedoop appli- 
cation is installed, it logs an entry in the registry database 
indicating the CLASS/DNS ID(s) that it will handle. 
Thereafter, when an object with such a CLASS/DNS ID is 
encountered, the operating system automatically launches 
the corresponding application to service the Bedoop data in 
an appropriate manner. 

Sometimes the computer system may encounter a Bedoop 
object for which it does not have a registered application 
program. In such case, a default Bedoop application can be 
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invoked. This default application can, e.g., establish an 
internet link to a remote server computer (or a network of 
such computers), and can transmit the Bedoop data (or a part 
of the Bedoop data) to that remote computer. The remote 

5 server can undertake the response itself, it can instruct the 
originating computer how to respond appropriately, or it can 
undertake some combination of these two responses. (Such 
arrangements are further considered below.) 
FIG. 2 shows an illustrative architecture employing the 

10 foregoing arrangement. 

At a local Bedoop system 28 (which may be implemented, 
for example, using a conventional personal computer 29), a 
camera, scanner, or other optical sensor 30 provides image 
data to a decoder 32 (which may be implemented as a 

15 software component of the operating system 33), The 
decoder 32 analyzes the image data to discern the plural-bit 
Bedoop data. The CLASS ID of this Bedoop data is applied 
to a Bedoop registry 34. The registry responds by identifying 
and launching a local Bedoop application 36 designed to 

20 service the discerned Bedoop data. 

Sometimes the system 28 may encounter a Bedoop object 
for which several different responses may be appropriate. In 
the case of a printed office document, for example, one 
response may be as described above — to preset the elec- 

25 tronic version of the file on a computer, ready for editing. 
But other responses may also be desired, such as writing an 
email message to the author of the printed document, with 
the author's email address already specified in the message 
address field, etc. 

30 Such different responses may be handled by different 
Bedoop applications, or may be options that are both pro- 
vided by a single Bedoop application. In the former case, 
when the CLASS/DNS IDs are decoded and provided to the 
operating system, the registry indicates that there are two (or 

35 more) programs that might be invoked. The operating sys- 
tem can then present a dialog box to the user inviting the user 
to specify which form of response is desired. Optionally, a 
default choice can be made if the user doesn't specify within 
a brief period (e.g., three seconds). The operating system can 

40 then launch the Bedoop application corresponding to the 
chosen response. 

A similar arrangement can be employed if a single 
Bedoop application can provide both responses. In such case 
the operating system launches the single Bedoop application 

45 (since there is no ambiguity to be resolved), and the appli- 
cation presents the choice to the user. Again, the user can 
select, or a default choice can be automatically made. 

In the just-described situations, the user can effect the 
choice by using the keyboard or mouse — as with traditional 

50 dialog boxes. But Bedoop provides another, usually easier, 
form of interaction. The user can make the selection through 
the optical sensor input. For example, moving the object to 
the right can cause a UI button on the right side of the dialog 
box to be selected; moving the object to the left can cause 

55 a Ul button on the left side of the dialog box to be selected; 
moving the object towards the camera can cause the selected 
button to be activated. Many other such techniques are 
possible, as discussed below. 

If the registry 34 does not recognize, or otherwise does 

60 not know how to respond to Bedoop data of that particular 
CLASS/DNS, the registry launches a default Bedoop client 
application. This client application, in turn, directs a web 
browser 40 on the local Bedoop system 28 to communicate 
with a remote master registration server computer 42. The 

65 local computer forwards the Bedoop data to this master 
server. The master server 42 examines the CLASS ID, and 
forwards the Bedoop data (directly, or through intervening 
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servers) to a corresponding CLASS server 44. (A single 
server may handle Bedoop data of several classes, but more 
typically there is a dedicated server for each CLASS.) 

Each CLASS server 44 serves as the root of a tree 46 of 
distributed DNS servers. A DNS server 48a, for example, in 
a first tier 50 of the DNS server tree, may handle Bedoop 
data having DNS IDs beginning with "000." Likewise, DNS 
server 48fc may handle Bedoop data having DNS IDs 
beginning with "001," etc., etc. 

Each DNS server in the first tier 50 may, in turn, route 
Bedoop data to one of 8 servers in a second tier of the tree, 
in accordance with the fourth- through sixth bits of the DNS 
data. The tree continues in this fashion until a terminal level 
of DNS leaf node servers 56. 

Ultimately, Bedoop data routed into this network reaches 
a DNS leaf node server 56. That leaf node server may handle 
the Bedoop data, or may redirect the local Bedoop system to 
a further server 58 that does so. That ultimate server — 
whether a DNS leaf node server or a further server — can 
query the local Bedoop system for further information, if 
necessary, and can either instruct the local Bedoop system 
how to respond, or can undertake some or all of the response 
itself and simply relay appropriate data back to the local 
Bedoop system. 

In arrangements in which the local Bedoop system is 
redirected, by the DNS leaf node server, to a further server 
that actually handles the response, access to the further 
server may be through a port 59 (e.g., a special URL) 
tailored to receipt of Bedoop data. 

In a typical implementation, most or all of the servers are 
mirrored, or otherwise replicated/redundant, so that failure 
of individual computers does not impair operation of the 
system. 

Caching can be provided throughout the trees of servers 
to speed responses. That is, responses by leaf nodes for 
certainly commonly-encountered CLASS/DNS IDs can be 
temporarily stored earlier in the tree(s). Bedoop data, propa- 
gating through the server network, can prompt a response 
from an intermediate server if there is a cache hit. 

If desired, Bedoop traffic through the above-detailed 
server trees can be monitored to collect demographic and 
statistical information as to what systems are sending what 
Bedoop data, etc. One use of such information is to dynami- 
cally reconfigure the DNS network to better balance server 
loads, to virtually relocate DNS resources nearer regions of 
heavy usage, etc. Another use of such information is for 
marketing purposes, e.g., to promote certain Bedoop fea- 
tures and applications within user groups (e.g., internet 
domains) that seem to under-utilize those features. 

Within certain user networks that are linked to the 
internet, e.g., corporate networks, Bedoop data that isn't 
handled within the originating Bedoop system may first be 
routed to a Bedoop name server within the corporate net- 
work. That server will recognize certain types of Bedoop 
data, and know of resources within the corporate network 
suitable for handling same. Referral to such resources within 
the corporate network will be made, where possible. These 
resources (e.g., corporate servers) may respond to Bedoop 
data in a way customized to the corporate preferences. If the 
corporate Bedoop name server does not know of a resource 
within the corporate network that can respond to the Bedoop 
data, the corporate name server then routes the data to the 
public Bedoop network described above. (Such referral can 
be to the master registration server or, to the extent the 
corporate name server knows the addresses of appropriate 
servers within the DNS server tree, or of the further servers 
to which DNS servers may point for certain Bedoop data, it 
can redirect the local Bedoop system accordingly.) 
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In typical rich Bedoop implementations, local systems 
may have libraries of Bedoop services, applications, or 
protocols. Some may be unique to that computer. Others 
may be commonly available on all computers. Some may be 
highly secure, employing encryption and/or anti-hacking 
measures, or data protocols that are not generally recog- 
nized. Others may be shareware, or the result of open-source 
programming efforts. 
Greeting Cards, Birthday Cards, Etc. 

In accordance with a further embodiment of the invention, 
greeting cards and the like are encoded (e.g., by texturing, 
printing, etc.) with Bedoop data. On receiving such a card, 
a recipient holds it in front of the image capture device on 
a laptop or other computer. The computer responds by 
displaying an internet web page that has a stock- or 
customized-presentation (image, video, audio-video, etc.) to 
complement that presented on the greeting card. 

The web site presentation can be personalized by the 
sender (e.g., with a text message, recent family photographs, 
etc.), either at the point of card sale, or sometime after the 
card is purchased. In the latter case, for example, the card 
can be serialized. After taking the card home, the purchaser 
can visit the card vendor's web site and enter the card serial 
number in an appropriate user interface. The purchaser is 
then presented with a variety of simple editing tools to 
facilitate customization of the web greeting. When the 
sender is finished designing the web greeting, the finished 
web page data is stored (by software at the vendor's web 
site) at a site corresponding to the serial number. 

When the card is received by a recipient and held in front 
of a Bedoop sensor, CLASS, DNS, and UID data is decoded 
from the card. The CLASS and DNS data are used to 
navigate the earlier-described server network to reach a 
corresponding DNS leaf node server (perhaps maintained by 
the Hallmark greeting card company). That leaf node server 
indexes a table, database, or other data structure with the 
UID from the Bedoop data, and obtains from that data 
structure the address of an ultimate web site — the same 
address at which the web greeting customized by the sender 
40 was stored. That address is provided by the DNS leaf node 
server back to the local computer, with instructions that the 
web page at that address be loaded and displayed (e.g., by 
HTML redirection). The local computer complies, present- 
ing the customized web greeting to the card recipient. 

In the just-described embodiment, in which a pre -encoded 
card is purchased by a sender and the web-display is then 
customized, the address of the web site is typically deter- 
mined by the card vendor. But this need not be the case. 
Likewise, the card need not be "purchased" in the typical, 
card-shop fashion. 

To illustrate the foregoing alternatives, consider the 
on-line acquisition of a greeting card, e.g., by visiting a web 
site specializing in greeting cards. With suitable user- 
selection (and, optionally, customization), the desired card 
can be printed using an ink-jet or other printer at the sender's 
home. In such case, the Bedoop data on the card can be 
similarly customized. Instead of leading to a site determined 
by the card vendor, the data can lead to the sender's personal 
web page, or to another arbitrary web address. 

To effect such an arrangement, the sender must arrange 
for a DNS leaf node server to respond to a particular set of 
Bedoop data by pointing to the desired web page. While 
individuals typically will not own DNS servers, internet 
service providers commonly will. Just as AOL provides 
simple tools permitting its subscribers to manage their own 
modest web pages, internet service providers can likewise 
provide simple tools permitting subscribers to make use of 
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DNS leaf node servers. Each subscriber may be assigned up The candidate incorporates this photo into an access 

to 20 UIDs (under a particular CLASS and DNS). The tools badge. Using a software application (which may be provided 

would permit the users to define a corresponding web especially for such purposes, e.g., as part of an office 

address for each UID. Whenever a Bedoop application led to productivity suite), the photo is dragged into an access badge 

that DNS leaf node server, and presented one of those UIDs, 5 template. The access code emailed from the employer is also 

the server would instruct the originating computer to load pr0 vided to this application. On selecting "Print/ 1 an ink-jet 

and present the web page at the corresponding web address primer associated with tne candidate's computer prints out 

' . . . . . an access badge that includes her DM V photo and her name. 

Prior to customing the greetmg card, the sender uses he and ^ ^ s * ganographical]y encoded in accordance with 

tool provided by the internet service provider to store the Hn # . „ , -5 / ^ 

r r j • j j *■ *• ujj ■ 10 the employer-provided access code, 

address of a desired destination web address in correspon- ™ r ; f . , ■ « l. j . L ■ i • 

dence with one of the sender's available UIDs, When ^ na , me P™ted on the badge is obtained (by the 

customizing the greeting card, the sender specifies the caadldate * computer) from the DMV s DNS server, in 

Bedoop data that is to be encoded, including the just- response to Bedoop data extracted from the photograph. (In 

referenced UID. The greeting card application encodes this ^is application, unlike most, the photograph is not scanned 

data into the artwork and prints the resulting card. When this 15 as P arl of a Bedoop process. Instead, the photograph is 

card is later presented to a Bedoop system by the recipient, already available in digital form, so the Bedoop decoding 

the recipient's system loads and displays the web page proceeds directly from the digital representation.) 

specified by the sender. For security purposes, the access code is not embedded 

Commerce in Bedoop Resources using standard Bedoop techniques. Instead, a non-standard 

In the just-described arrangement, internet service pro- 20 format (typically steganographic) is employed. The embed- 

viders make available to each subscriber a limited number of ding of this access code can span the entire face of the card, 

UIDs on a DNS server maintained by the service. Business or can be limited to certain regions (e.g., excluding the 

enterprises typically need greater Bedoop resources, such as region occupied by the photograph), 

their own DNS IDs (or even their own CLASS ID(s). On the appointed day the candidate presents herself at the 

While variants of the Bedoop system are extensible to 25 employer's building. At the exterior door lock, the candidate 
provide an essentially unlimited number of CLASS IDs and presents the badge to an optical sensor device, which reads 
DNS IDs, in the illustrated system these resources are the embedded building access code, checks it for authentic- 
limited. Public service, non-profit, and academic applica- ity and, if the candidate arrived within the permitted hours, 
tions should have relatively generous access to Bedoop unlocks the door. 

resources, either without charge or for only a modest charge. 30 Inside the building the candidate may encounter a security 

Business enterprises, in contrast, would be expected to pay guard. Seeing an unfamiliar person, the guard may visually 

fees to moderate their potentially insatiable demand for the compare the photo on the badge with the candidate's face, 

resources. Small businesses could lease blocks of UIDs Additionally, the guard can present the badge to a portable 

under a given CLASS/DNS ID. Larger businesses could Bedoop device, or to one of many Bedoop systems scattered 

acquire rights to entire DNS IDs, or to entire CLASS IDs (at 35 through the building (e.g., at every telephone). The Bedoop 

commensurately greater fees). system extracts the Bedoop data from the card (i.e., from the 

Web-based systems for assigning DNS IDs (and CLASS DMV photograph), interrogates the DMV's DNS server 

IDs) can be modeled after those successfully used by with this Bedoop data, and receives in reply the name of the 

Internic.com, and now Networksolutions.com, for registra- person depicted in the photograph. (If the Bedoop system is 

tion of internet domains. The user fills out a web-based form 40 a telephone, the name may be displayed on a small LCD 

with names, addresses, and billing information; the system display commonly provided on telephones.) 

makes the necessary changes to all of the hidden system The guard checks the name returned by the Bedoop 

infrastructure — updating databases, routing tables, etc., in system with the name printed on the badge. On seeing that 

servers around the world. the printed and Bedoop-decoded names match (and option - 

Controlled-Access ID 45 ally checking the door log to see that a person of that name 

Just as the above-described embodiment employed an was authorized to enter and did so), the security guard can 

ink-jet printer to produce a customized-Bedoop greeting let the candidate pass. 

card, the same principles can likewise be applied to access- It will be recognized that the just -described arrangement 

control objects, such as photo-IDs. offers very high security, yet this security is achieved 

Consider an employment candidate who will be inter- 50 without the candidate ever previously visiting the employer, 

viewing at a new employer. The candidate's visit is without the employer knowing what the candidate looks 

expected, but she is not recognized by the building's security like, and by use of an access badge produced by the 

personnel. In this, and many other applications, arrange- candidate herself. 

ments like the following can be used: Variants of such home-printed badge embodiments find 

The employer e-mails or otherwise sends the candidate an 55 numerous applications. Consider purchasing movie- or 

access code. (The code can be encrypted for transmission.) event-tickets over the web. The user can print an access 

The code is valid only for a certain time period on a given ticket that has an entry code embedded therein. On arriving 

date (e.g., 9:00 a.m.-ll:00 a.m. on Jun. 29, 1999). at the theater or event, the user presents the ticket to an 

Upon receipt of the access code, the candidate downloads optical scanning device, which decodes the entry code, 

from the web site of the state Department of Motor Vehicles 60 checks the validity of same, authorizes the entry, and marks 

the latest copy of her driver's license photo. The DMV has that entry code as having been used (preventing multiple 

already encoded this photo with Bedoop data. This data uses of tickets printed with the same code), 

leads to a state-run DNS leaf node server 56. When that Ink-Jet Printing 

server is presented with a UID decoded from a photograph, In the foregoing discussions, reference has been made to 

the server accesses a database and returns to the inquiring 65 use of ink-jet printing as a means for providing stegano- 

computer a text string indicating the name of the person graphically encoded indicia on substrates. The following 

depicted by the photograph. discussion expands on some of the operative principles. 
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The basic physics and very low level analog electronic Some customers present personal coffee mugs to the cashier, 

operation of ink-jet printers (sometimes termed bubble-jet preferring the sensation of ceramic or metal to paper, and 

printers) are ideally suited to support very-light-tint back- avoiding the trash/recycle dilemma, 

ground digital watermarking on any form of substrate. The drinker's "regular" order can be Bedoop-encoded 

(Watermarking through apparent "tinting" of substrates is 5 either on the mug itself or, more commonly, on an adhesive 

discussed in copending application Ser. No. 09/127,502.) In label applied l0 the mug nt encoding can be in addition to 

general, the statement, "if you can print it with an ink jet other aesl hetic imagery (e.g., artwork or a photo), or the 

printer, you can watermark it" is largely accurate, even for markb ^ be { daU Ubek me size of 

(perhaps especially for) simple text documents. Indeed, stamps mav be used. 

there is a degree of flexibility and control in the ink-jet 1A u«„i;„„ ,u a * rt tu~ t u a ™„, 

. . i iL , • ii *i i_i * 10 On handing the mug to the cashier, the customer can 

printing realm that is not as generally available in more . . ° . ~™ , . 4lm * e 

traditional printing technologies^ such as commercial offset ^ sa y f re S u ! ar - ™ e ^hier passes the mug in front 

printing and other plate-based technologies. (This is not to of J c °P tlc u al ^ devi ^ of a Bedoo P s y stem ff 0 ^" 

say that ink-jet has better quality than plate-based technolo- * led Wllh * he ™ sh T ^ v ' ™ e svslem steganograpbically 

gies; it has more to do with the statistics of ink droplets than decodes the data and provides the corresponding order 

anything else.) Heavier tint backgrounds are possible as « ("half-decaf, short, skinny latte"), either textually or audibly 

well, where the continuum ranges from very light back- ( e -g*> b Y a voice synthesizer) to the cashier or the barrista. 

ground tinting, where the casual observer will see "white The cash register system also knows the current price of the 

paper/' all the way through heavily inked patterned requested drink, and rings up the charge accordingly, 

backgrounds, and photographs themselves, and everything Labels of the type described can be available to the 

in between. 20 cashier on pre-printed rolls, just as with other adhesive 

In some embodiments, the ink-jet driver software is stickers, or can be printed on-demand. (Small label printers 

modified to provide lower-level control of individual droplet may be best suited in the latter case, given space constraints 

emission than is provided in existing printer drivers, which in retail outlets.) Customers ordering drinks for personal 

are naturally optimized for text and graphics. In some such mugs may be invited to take a label corresponding to their 

embodiments, the "watermarking" print mode is another 25 just-ordered drink and apply it to their mug for future use. 

option from which the user can select (e.g., in addition to In variants on this basic theme, the mug label can be 

High Quality, Econo-Fast, etc.), or the selection can be made further encoded (or a supplemental label can be provided 

automatically by application software that is printing water- and encoded) with electronic payment information, such as 

marked data. the customer's credit card number, or the number of a debit 

In more sophisticated embodiments, the watermark data is 30 account maintained by the coffee merchant for that cus- 

applied to the printer driver software independently of the tomer. When the mug is scanned for the drink order, the 

other image/text data. The printer driver is arranged to eject system likewise detects the payment information and 

droplets in the usual print density for the image/text data, charges the corresponding fee to the appropriate account, 

and at a more accurately-controlled, finer density for the (For security reasons, the system may be arranged so that the 

separately-applied watermark data. (The latter may be 35 mug cannot be used to authorize more than, say $5 of coffee 

effected as a slight modulation signal on the former.) This drink purchases per day.) 

arrangement provides for essentially transparent integration In another variant on this theme, the system maintains an 

into existing printer environments — no one need worry electronic log of coffee purchases made by the customer and, 

about the watermarking capability except the software appli- in accordance with then-prevailing marketing 

cations that specifically make use of same. 40 considerations, rewards the customer with a free drink after 

Consumer Marking of Web-Based Materials 8 or 12, etc., drinks have been purchased. 

Various items of printed media can originate off the web, In still another variant on this theme, regular customers 

yet be printed at home. Examples include movie tickets, who use Bedoop-labeled mugs can participate in periodic 

coupons, car brochures, etc. Bedoop data can be added, or promotions in which, for example, every N* such customer 

modified, by the software application or by the printer driver 45 is rewarded with a cash or merchandise prize. Bells go off 

at the time of printing. (Alternatively, the Bedoop data can when the mug is scanned. (N can be a fixed number, such 

be customized to correspond to the user before being down- as 500, or can be a random number — typically within a 

loaded to the user's system for printing.) known range or with a known mean.) 

One advantage to Bedoop -encoding printed images Smart Elevators 
locally, as opposed to Bedoop-encoding the image files prior 50 In accordance with another embodiment of the invention, 
to downloading for local printing, is that the encoding can be a building elevator is provided with one or more optical 
tailored in accordance with the particular properties of the capture devices. Each device examines monitors the con- 
local printer (e.g., to increase robustness or decrease tents of the elevator chamber looking for Bedoop encoded 
visibility) — properties not generally known to a remote objects, such as ID badges. On sensing a Bedoop-encoded 
server. 55 object, the elevator can determine — among other data — the 

In one particular example, the UID field in the Bedoop floor on which the wearer's office is located. The system can 

data can be written with a value that serves as an index to a then automatically direct the elevator to that floor, without 

database of user profiles, permitting later systems to which the need for the person to operate any buttons. (The eleva- 

the printed item is presented to personalize their response in tor's button panel can be provided with a new, override 

accordance with the profile data. 60 button that can be operated to un -select the most recently 

In another example, the UID field serves an authentication selected floor(s), e.g., in case a user wants to travel to a 

purpose, e.g., to verify that the printed medium actually was different floor.) To aid in identification, the Bedoop objects 

printed at a particular place, or by a particular user or at a (e.g., badges) can be colored a distinctive color, permitting 

particular time. the system to more easily identify candidate objects from 

Coffee Mug 65 other items within the optical capture devices field of view. 

At retail coffee outlets, customers commonly order the Or the object can be provided with a retro-reflective coating, 

same drink day after day ("half-decaf, short, skinny latte"). and the elevator can be equipped with one or more illumi- 
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nation sources of known spectral or temporal quality (e.g., (s) that provides the Bedoop technology and infrastructure 

constant infra red, or constant illumination with a single- or through which the higher value is achieved, 

multi-line spectrum, or a pulsed light source of known Business Card Applications 

periodicity; LEDs or semiconductor lasers, each with an Conventional business cards can be steganographically 

associated diffuse r, can be used for each the foregoing and 5 encoded with Bedoop data, e.g., by texturing, watermark 

can be paired with the image capture devices). Other such tinting, ink-jet splattering, text steganography, etc. As with 

tell-tale clues can likewise be used to aid in object location. many of the earlier-described embodiments, the stegano- 

In all such cases, the optical capture device can sense the graphic encoding is tailored to facilitate decoding in the 

tell-tale clue(s) using a wide field of view sensor. The device presence of arbitrary rotation or scale distortion of the card 

can then be physically or electronically steered, and/or 10 introduced during scanning. (Some such techniques are 

zoomed, to acquire a higher resolution image of the shown, e.g., in applicant's related patents identified above, 

digitally-encoded object suitable for decoding. Various other techniques are known to artisans.) 

Magazines When a recipient of a business card holds it in front of a 

Magazine (and newspaper) pages can be steganographi- Bedoop sensor, the operating system on the local system 

cally encoded with Bedoop data to provide another "paper as 15 launches a local Bedoop application. That local Bedoop 

portal" experience. As with the earlier described office application, in turn, establishes an external internet connec- 

document case, the encoded data yields an address to a tion to a remote business card server. The address of that 

computer location (e.g., a web page) having the same, , or server may already be known to the local Bedoop applica- 

related, content. tion (e.g., having been stored from previous use), or the local 

In one exemplary embodiment, the blank magazine page 20 Bedoop system can traverse the above-described public 

stock is Bedoop-encoded prior to printing. The watermark- network of DNS servers to reach the business card server, 

ing can be performed by high speed ink-jet devices, which A database on the business card name server maintains a 

splatter a fine pattern of essentially imperceptible ink drop- large collection of business card data, one database record 

lets across each page. Each page can be differently water- per UID. When that server receives Bedoop data from a local 

marked so that, on decoding, page 21 of a magazine can be 25 Bedoop system, it parses out the UID and accesses the 

distinguished from page 22 of the same magazine (and page corresponding database record. This record typically 

106 of the Jun. 21, 1999, issue can be distinguished from includes more information than is commonly printed on 

page 106 of the Jun. 28, 1999, issue). If desired, each page conventional business cards. Sample fields from the record 

can be further segregated into regions — either in accordance may include, for example, name, title, office phone, office 

with the actual boundaries of articles that will later be 30 fax, home phone, home fax, cellular phone, email address, 

printed on the pages, or in a grid pattern, e.g., of 3 columns company name, corporate web page address, personal web 

across by 5 rows high. Each region conveys a distinct page address, secretary's name, spouse's name, and birth- 

Bedoop code, permitting different portions of the page to day. This record is transmitted back to the originating 

lead to different web data.) Bedoop system. 

After watermarking and printing, the pages thus produced 35 The local Bedoop system now has the data, but needs 

are bound in the usual fashion with others to form the further instruction from the user as to how it should be 

finished magazine. (Not all pages in the magazine need to be processed. Should a telephone number be dialed? Should the 

watermarked.) information be entered into a personal contact manager 

Of course, the watermarking can be effected by processes database (e.g., Outlook) on the local system? Etc. 

other than ink-jet printing. For example, texturing by pres- 40 In an exemplary embodiment, the local system presents 

sure rollers is another option well suited for the large the available choices to the user, e.g., by textual prompts, 

volumes of paper to be processed. synthesized voice, etc. The user responds by manipulating 

On presenting a magazine to the optical scanner device of 9 the business card in a manner prompted by the system (e.g., 
a Bedoop-compliant computer, the computer senses the move down to telephone at office; move up to telephone at 
Bedoop data, decodes same, and launches a web browser to 45 home; move right to access corporate web page; move left 
an internet address corresponding to the Bedoop data. If the to access personal web page; rotate left to enter certain 
magazine page is an advertisement, the internet address can elements from the database record (filtered in accordance 
provide information complementary to the advertisement. with a template) into personal contact manager database, etc. 
For example, if the magazine page is an advertisement for a The local Bedoop system responds accordingly, 
grocery item, the Bedoop data can identify a web page on 50 Some card givers may choose to make additional infor- 
which recipes using the advertised item are presented. If the mation available to card recipients — information beyond 
magazine page includes a photo of a tropical beach, the that known in prior art contact-management software appli- 
Bedoop data can lead to a travel web page (e.g., hosted by cations. For example, one of the choices presented by a local 
Expedia or other travel service) that presents fare and Bedoop system in response to presentation of a business 
lodging information useful to a reader who wants to vacation 55 card may be to review the card-giver's personal calendar, 
at the illustrated beach. (The fare information can be cus- (The card -giver can maintain his or her personal calendar on 
tomized to the reader's home airport by reference to user a web -accessible computer.) By such arrangement, the card- 
profile data stored on the user's computer and relayed to the recipient can learn when the card-giver may be found in the 
web site to permit customization of the displayed page.) office, when appointments might be scheduled, etc., etc. 

The data to which the Bedoop data leads needn't be static; 60 Typically, access to this web-calendar is not available to 

it can be updated on a weekly, daily, or other basis. Thus, if casual web browsers, but is accessible only in response to 

a months-old magazine page is presented to a Bedoop Bedoop data (which may thus be regarded as a form of 

device, the resultant data can be up-to-the-minute. authentication or password data). 

In the case of advertising, the inclusion of Bedoop data Some users may carry several differently-encoded cards, 

increases the value of the ad to the advertiser, and so merits 65 each with a different level of access authorization (e.g., with 

a higher charge to the advertiser from the magazine pub- different UIDs). Thus, some cards may access a biographical 

lisher. This higher charge may be shared with the enterprise page without any calendar information, other cards may 
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access the same or different page with access enabled to opens a web browser to a web page address corresponding 

today's calendar, or this week's calendar, only, and still other to Bedoop data on the card. If the card is twisted to the right, 

cards (e.g., the "spouse" card) may access the same or the computer opens an e-mail template, p re-addressed to an 

different page with access enabled for the card-giver* s e-mail address indicated by the card, 

complete calendar. The user can distribute these different 5 In other examples, twisting an object to move the right 

cards to different persons in accordance with the amount of edge towards the scanner can be used to effect a right mouse 

personal information desired to be shared with each. click input, and twisting the object to move the right edge 

In accordance with a related embodiment, the database away from the scanner can be used to effect a left mouse 

record corresponding to Bedoop business card data can click input. 

include a "now" telephone number field. This field can be 10 Simultaneous changes in two of these four positioning 

continually-updated throughout the day with the then-most- variables can be used to provide one of four different inputs 

suitable communications channel to the card-giver. When to the computer (e.g., (a) twisting left while moving in; (b) 

the card -giver leaves home to go to the office, or leaves the twisting left while moving out; (c) twisting right while 

office for a trip in the car, or works a week at a corporate moving in; and (d) twisting right while moving out). Simul- 

office in another town, etc., this data field can be updated 15 taneous changes to three or all four of these variables can 

accordingly, (A pocket GPS receiver, with a wireless uplink, similarly be used to provide one of eight or sixteen different 

can be carried by the person to aid in switching the "now" inputs to the computer. 

number among various known possibilities depending on Simultaneous manipulations of the object in two or more 

the person's instantaneous position.) When this database of these modes is generally unwieldy, and loses the simple, 

record is polled for the "now" number, it provides the 20 intuitive, feel that characterizes manipulation of the object in 

then -current information. one mode. However, a similar effect can be achieved by 

Consider a Bedoop-enabled public telephone. To dial the sequential, rather than simultaneous, manipulation of the 

phone, a business card is held in front of the Bedoop sensor card in different modes (e.g., twist left, then move in), 

(or slid through an optical scanner track). The phone inter- Moreover, sequential manipulations permit the same mode 

rogates the database at the business card server for the 25 to be used twice in succession (e.g., move in, then move 

"now" number and dials that number. out). By such sequential manipulations of the object, arbi- 

To update the any of the fields stored in the database trarily complex input can be conveyed to the Bedoop 

record, the card giver can use a special card that provides system. 

write -authorization privileges. This special card can be a (It will be recognized that a digitally-encoded object is not 

specially encoded version of the business card, or can be 30 necessary to the gestural-input applications described above, 

another object unique to the card-giver (e.g., the card-giver's Any object (talisman) that can be distinguished in the image 

driver's license). data can be manipulated by a user in the manners described 

The reference to business cards and personal calendars is above, and an appropriate system can recognize the move- 
illustrative only. Going back a century, "calling cards" were ment of the object and respond accordingly. The provision of 
used by persons whose interests were strictly social, rather 35 digital data on the object provides a further dimension of 
than business. The just-discussed principles can be similarly functionality (e.g., permitting the same gesture to mean 
applied. Teenagers can carry small cards to exchange with different things, depending on the digital encoding of the 
new acquaintances to grant access to private dossiers of object being manipulated), but this is not essential, 
personal information, favorite music, artwork, video clips, Moreover, even within the realm of digitally-encoded 
etc. The cards can be decorated with art or other indicia that 40 gestural talismans, steganographic encoding is not essential, 
can serve purposes wholly unrelated to the Bedoop data Any other known form of optically-recognizable digital 
steganographically encoded therein. encoding (e.g., ID and 2D bar codes, etc.) can readily be 
Gestural Input employed. 

A Bedoop system can determine the scale state, rotation In an illustrative embodiment, a business card or photo- 
state, X-Y offset, and differential scale state, of an object by 45 graph is used as the talisman, but the range of possible 
reference to embedded calibration data, or other techniques. talismans is essentially unlimited. 
If the scan device operates at a suitably high frame rate (e.g., Gestural Decoding Module 

five or ten frames per second), change(s) in any or all of There are various ways in which the Bedoop system's 

these four variables can be tracked over time, and can serve decoding of gestural input can be effected. In some Bedoop 

as additional input. 50 systems, this functionality is provided as part of the Bedoop 

In an earlier-discussed example, moving an object to the applications. Generally, however, the applications must be 

left or right in front of the Bedoop scanner caused a left- or provided with the raw frame data in order to discern the 

right-positioned button in a dialog box to be selected. This gestural movements. Since this functionality is typically 

is a change in the X-Y offset of the scanned object. In that utilized by many Bedoop applications, it is generally pref- 

earlier example, moving the object inwardly towards the 55 erable to provide a single set of gestural interpretation 

camera caused the selected button to be activated. This is a software functions (commonly at the operating system level) 

change in the scale state of the scanned object. to analyze the frame data, and make available gestural 

In similar fashion, twisting the object to the left or right output data in standardized form to all Bedoop applications, 

can prompt one of two further responses in a suitably In one such system, a gestural decoding module tracks the 

programmed Bedoop application. (This is a change in the 60 encoded object within the series of image data frames, and 

rotation state.) Likewise, tilting the object so that one part is outputs various parameters characterizing the object's posi- 

moved towards or away from the camera can prompt one of tion and manipulation over time. Two of these parameters 

two further responses in the application. (This is a change in indicate the X-Y position of the object within current frame 

the differential scale state.) of image data. The module can identify a reference point (or 

In the business card case just-discussed, for example, the 65 several) on the object, and output two corresponding posi- 

card can be held in front of the Bedoop scanner of a tion data (X and Y). The first represents the horizontal offset 

computer. If the card is twisted to the left, the computer of the reference point from the center of the image frame, 
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represented as a percentage of frame width. A two's comple- able from each other regardless of angular position of the 

ment representation, or other representation capable of object, if data in the full range of Q-360 degrees is to be 

expressing both positive and negative values, can be used so represented. If these two points are not distinguishable, it 

that this parameter has a positive value if the reference point may only be possible to represent data in the range of 0-180 

is right of center-frame, and has a negative value if the 5 degrees.) As before, a dynamic parameter C can also be 

reference point is left of center frame. The second parameter, discerned to express the change in the rotation state param- 

Y, similarly characterizes the position of the reference point eter c since me Iast frame - ™ s parameter can be in seven 

above or below center-frame (with above-being represented b [ l > two ! s complement form, with positive values indicating 

by a positive value). Each of these two parameters can be ch ™& L a 3 clockwise rotation 

expressed as a seven-bit byte. A new pair of X,Y parameters 10 ™ c forc S oin S ^chniques and representation 

is output from the gestural decoding module each time a new mctncs ' arc of <* urse ^ u ™ c ?"!/■ ^ ^ 

c r • j • j recognize many other arrangements that can meet the needs 

frame of image data is processed of t * Bedoop a * plications being served 

In many applications, the absolute X-Y position of the In the iUustrative sys tem, the Bedoop application pro- 
object is not important. Rather, it is the movement of the grams commun i cate with the gestural decoding module 
object in X and Y from frame-to-frame that controls some 15 through a standardized set of interface protocols, such as 
aspect of the system's response. The Bedoop application can ^pi s One API can query the gestural input module for some 
monitor the change in the two above-described parameters, 0 r all of the current position parameters (e.g., any or all of 
frame to frame, to discern such movement. More commonly, X, Y, A, B, and C). The module responds to the calling 
however, the gestural decoding module performs this func- application with the requested parameters). Another API 
tion and outputs two further parameters, X' and Y\ The 20 can query the gestural input module for some or all of the 
former indicates the movement of the reference point in current movement data (e.g., any or all of X', Y', A', B* and 
right/left directions since the last image frame, as a percent- C). Still another API can request the gestural decoding 
age of the full-frame width. Again, this parameter is repre- module to provide updated values for some or all of the 
sented in two's complement form, with positive values position or movement data on a running basis, as soon as 
representing movement in the rightward direction, and nega- 25 they are discerned from each frame. A complementary API 
tive values representing movement in the leftward direction. discontinues the foregoing operation. By such arrangement, 
The later parameter similarly indicates the movement of the all of the gestural data is available, but the Bedoop appli- 
reference point in up/down directions since the last frame. cation programs only obtain the particular data they need, 

The scale, differential scale, and rotation states of the and only when they ask for it. 

object can be similarly analyzed and represented by param- 30 In Bedoop applications that communicate with external 

eters output from the gestural decoding module. servers, just the Bedoop data (i.e., CLASS, DNS, and 

Scale state can be discerned by reference to two (or more) optionally UID) may initially be sent. If the remote server 

reference points on the object (e.g., diagonal corners of a needs to consider gestural data in deciding how to respond, 

card). The distance between the two points (or the area the remote server can poll the local Bedoop system for the 

circumscribed by three or more points) is discerned, and 35 necessary data. The requested gestural data is then sent by 

expressed as a percentage of the diagonal size of the image the local Bedoop system to the remote server in one or more 

frame (or its area). A single output parameter, A, which may separate transmissions. 

be a seven-bit binary representation, is output. In other embodiments, since the gestural data is of such 

As with X-Y data, the gestural decoding module can low bandwidth (e.g., roughly 56 bits per image frame), it 

likewise monitor changes in the scale state parameter since 40 may routinely and automatically be sent to the remote 

the last frame, and product a corresponding output parameter computer, so that the gesture data is immediately available 

A'. This parameter can be expressed in two's complement in case it is needed. In an illustrative implementation, this 

form, with positive values indicating movement of the data is assembled into an 8-byte packet, with the first byte 

object towards the sensor since the last frame, and negative of the packet (e.g., the X parameter) being prefixed with a 

values indicating movement away. 45 "1" sync bit, and subsequent bytes of the packet being 

A differential scale parameter, B, can be discerned by prefixed with" 0" sync bits. (The sync bits can be used to aid 

reference to four reference points on the object (e.g., center in accurate packet decoding.) 

points on the four edges of a card). The two points on the In some embodiments, it is useful to provide for an 

side edges of the card define a horizontal line; the two points extension to the normal 64-bit Bedoop length to accommo- 

on the top and bottom edges of the card define a vertical line. 50 date an associated packet of gestural data. This can be 

The ratio of the two line lengths is a measure of differential effected by use of a reserved bit, e.g., in the UID field of the 

scale. This ratio can be expressed as the shorter line's length Bedoop packet. This bit normally has a "0" value. If it has 

as a percentage of the longer line's length (i.e., the ratio is a "1" value, that indicates that the Bedoop data isn't just the 

always between zero and one). Again, a two's complement usual 64 bits, but instead is 128 bits, with the latter 64 bits 

seven-bit representation can be used, with positive values 55 comprising a packet of gestural data, 

indicating that the vertical line is shorter, and negative Similar extension protocols can be used to associate other 

values indicating that the horizontal line is shorter. (As ancillary data with Bedoop data. A different reserved bit in 

before, a dynamic parameter B' can also be discerned to the UID field, for example, may signal that a further data 

express the change in the differential scale parameter B since field of 256 bits follows the Bedoop data — a data field that 

the last frame, again in two's complement, seven bit form.) 60 will be interpreted by the remote computer that ultimately 

A rotation state parameter C can be discerned by the services the Bedoop data in a known manner. (Such bits may 

angular orientation of a line defined by two reference points convey, e.g., profile data, credit card data, etc.) The 

on the object (e.g., center points on the two side edges of a appended data field, in turn, may include one or more bits 

card). This parameter can be encoded as a seven-bit binary signaling the presence of still further appended data, 

value representing the percentage of rotational offset in a 65 Grandmothers 

clockwise direction from a reference orientation (e.g., It is a common complaint that computers are too complex 

horizontal). (The two reference points must be distinguish- for most people. Attempts to simplify computer-user inter- 
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action to facilitate use by less experienced users usually 
serve to frustrate more experienced users. 

In accordance with another embodiment of the present 
invention, the sophistication of a computer user is stegano- 
graphically indicated on a talisman used by that user to 
interact with the system. The computer detects this 
steganographically-encoded data, and alters its mode of 
interacting with the user accordingly. 

Consider internet browser software. Experienced users 
are familiar with the different functionality that can be 
accessed, e.g., by various drop-down menus/sub-menus, by 
the keyboard shortcuts, by the menus available via right- 
clicking on the mouse, by manipulating the roller mouse 
scroll wheel and scroll button, etc., etc. Grandmothers of 
such users, typically, are not so familiar. 

Although gestural interfaces hold great promise for sim- 
plifying user-computer interaction, the same dichotomy 
between experienced users and inexperienced users is likely 
to persist, frustrating one class of user or the other. 

To help close this gap, a computer system according to 
this embodiment of the invention responds to gestures in 
different manners, depending on the expertise level indi- 
cated by encoding of the talisman. For an expert user, for 
example, the gestural interface active in the internet browser 
software may display the stored list of Favorite web 
addresses in response to tipping the left edge of the talisman 
towards the optical sensor. Once this list is displayed, the 
expert user may rotate the talisman to the right to cause the 
highlighting to scroll down the list from the top. Rotating the 
talisman to the left may scroll the list of Favorites up from 
the bottom. The speed of scrolling can be varied in accor- 
dance with the degree of rotation of the talisman from a 
default orientation. 

In contrast, for the novice user, these talisman manipula- 
tions may be confounding rather than empowering. Tipping 
the left edge of the talisman towards the sensor may occur 
as often by mistake as on purpose. For such users, a more 
satisfactory interface may be provided by relying on simple 
X-Y movement of the talisman to move an on-screen cursor, 
with a movement of the talisman towards the sensor to serve 
as a selection signal (i.e., like a left-mouse click). 

(In the example just-cited, the expert user summoned a list 
of Favorite web sites. Different "Favorites" lists can be 
maintained by the computer — each in association with dif- 
ferent talismans. A husband who uses one talisman is 
provided a different "Favorites" list than a wife who uses a 
different talisman.) 
Printed Pictures 

In accordance with this aspect of the invention, a printed 
photograph can be steganographically encoded with Bedoop 
data leading to information relating to the depicted person 
(e.g., contact information, biographical information, etc.). 

Such a photograph can be presented to a Bedoop sensor 
on a telephone. In a simple embodiment, the telephone 
simply processes the Bedoop data to obtain a corresponding 
default telephone number, and dials the number. In other 
embodiments, various options are possible, e.g., dial home 
number or dial work number. On presenting the photograph 
to the telephone, for example, moving the photo to the left 
may dial the person at home, while moving he photo to the 
right may dial the person at work. 

As telephones evolve into more capable, multi-function 
devices, other manipulations can invoke other actions. In a 
computer/telephone hybrid device, for example, rotating the 
photo counterclockwise may launch a web browser to an 
address at which video data from a web cam at the pictured 
person's home is presented. Rotating the photo clockwise 
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may present an e-mail form, pre-addressed to the e-mail 
address of the depicted person. Moving the photo to the right 
may query a database on the system for other photographs 
depicting the same individual or subject, which can be 

5 presented in response to further user input. Etc. 

In this and other embodiments, it is helpful for the Bedoop 
device to prompt the user to aid in manipulating the object. 
This can be done audibly (e.g., "move photo left to dial at 
home") or by visual clues (e.g., presenting left- or right- 

10 pointing arrows). 

Bedoop data in photographs can also be used to annotate 
the photographs, as with notes on the back of a photograph, 
or printed under the photograph in a photo album. The 
Bedoop data can lead to a remote database, where the 

15 photograph owner is permitted to enter a textual (or audio) 
narrative in association with each photograph's UID. Years 
later, when some of the names have been forgotten, the 
photograph can be positioned in front of a Bedoop sensor, 
and the system responds by providing the annotation pro- 

20 vided by the photograph owner years earlier. 
Drivers Licenses and Other Cards 

Drivers licenses, social security cards, or other identity 
documents may be encoded by the issuing authority with 
Bedoop data that permits access to the holder's personal 

25 records over the web. On presenting the document to a 
Bedoop system, the system directs a web browser to a 
private address corresponding to data encoded on the docu- 
ment. At that address, the holder of the document can review 
governmental records, such as state or federal tax return 

30 data, social security entitlements, etc., as well as privately- 
maintained records, such as credit records, etc. User selec- 
tion among various functions can be effected by spatial 
manipulation of the document. (Entry of additional data, 
such as social security number or mother's maiden name, 

35 may be required of the user to assure privacy in case the 
document is lost or stolen.) 

By manipulating a driver's license in front of a Bedoop 
sensor, a user can request renewal of the driver's license, and 
authorize payment of the corresponding fee. 

40 Bank cards (debit, credit, etc.) can similarly be encoded 
with Bedoop data to permit the holder to access bank records 
corresponding to the bank card account. (Entry of a PIN 
code may be required to assure privacy.) 
Such documents can also be used to access other personal 

45 data. One example is e-mail. A traveler might pause at a 
Bedoop kiosk at an airport and present a driver's license. 
Without anything more, the kiosk may present email that is 
waiting for the traveler on an associated display screen. 
On recognizing a driver's license, the kiosk can access a 

50 remote site (which may be maintained by the Department of 
Motor vehicles, another government entity, a private entity, 
or by the traveler), authenticating the operation by present- 
ing Bedoop data encoded on the license, and obtaining 
information that the person has pre-approved for release in 

55 response to such authorized access. This information can 
include e-mail account and password information. Using 
this information, the kiosk queries the corresponding e-mail 
server, and downloads a copy of recently received mail for 
presentation at the kiosk. (A user-entered PIN number may 

60 be required at some point in the process, e.g., in querying the 
remote site for sensitive e-mail password data, before pre- 
senting the downloaded e-mail for viewing, etc., to ensure 
privacy.) 

Other cards carried in wallets and purses can also be 
65 encoded to enable various functions. The local sandwich 
shop that rewards regular customers by awarding a free 
sandwich after a dozen have been purchased can encode 
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their frequent-buyer card with Bedoop data leading to the 
shop's web-based sandwich delivery service. Or the 
frequent-buyer card can be eliminated, and customers can 
instead wave their business card or other identity document 
in front of the shop's Bedoop sensor to get purchase credit 
in a tally maintained by the sandwich shop's computer. 

Food stamps, health insurance cards, and written medical 
prescriptions, can likewise be encoded with digital data to 
enable the provision of new functionality. 

At large trade shows, such as COMDEX, vendors needn't 
publish thick, glossy brochures to hand out to visitors. 
Instead, they may print various stylish promo cards for 
distribution. When later presented to a Bedoop sensor, each 
card leads to a web -based presentation — optionally includ- 
ing persuasive video and other multi-media components. 
The user can be prompted to provide data to customize, or 
focus, the presentation to the user's particular requirements. 
If the user wants further information, a request can be made 
by the click of a mouse (or the twist of a card). 
Prizes and Product Promotions 

Product packaging (e.g., Coke cans, Snapple bottles, 
Pepsi 12-pack boxes) can be encoded for contest purposes. 
The encoding can be customized, item to item, so that 
selected items — when Bedoop scanned — are recognized to 
be the one in a hundred that entitles the owner to a cash or 
merchandise prize. A remote server to which the item's 
Bedoop data is provided queries the user for contact infor- 
mation (e.g., address, phone number) so the prize can be 
awarded or, for smaller prizes, the system can print out an 
award certificate redeemable at local merchants for products 
or cash. Once a winning item is identified to the remote 
server, its UID on the server is marked as redeemed so that 
the item cannot later be presented to win another prize. 

In other such embodiments, all of the items are encoded 
identically. Winners are determined randomly. For example, 
during a contest period, persons around the world may 
present Coke cans to Bedoop systems. The corresponding 
Bedoop application on each user computer submits Bedoop 
data to a corresponding web address. The user's e-mail 
address may also be included with the submission. As this 
data is relayed to the corresponding server computer(s), 
every N** set of data is deemed to be a winner, and a 
corresponding award notification or prize is dispatched to 
the Bedoop system from which the winning set of data 
originated. 

The server computer that receives such contest submittals 
from client Bedoop systems can be arranged to prevent a 
single user from bombarding the server with multiple sets of 
data in an attempt to win by brute force. (This may be done, 
for example, by checking the included e-mail address, and 
not considering a data submittal if the same e-mail address 
was encountered in data submitted within the past hour. 
Similar anti-brute -force protection can be provided on the 
user's computer, preventing, e.g., repeated contest data to be 
sent more frequently than once per hour. More sophisticated 
anti-brute-force measures can of course be provided.) 
Product Information and Ordering 

In accordance with another embodiment of the present 
invention, product packaging and product advertisements 
can be encoded with Bedoop data that, when presented to a 
Bedoop system, initiates a link to a web page from which 
that product can be purchased, or more information 
obtained. Once the link has been established, the user can be 
instructed to manipulate the object in different of the earlier- 
described modes to effect different functions, e.g., move 
towards camera to order the product; move away from 
camera for product information. If the object is moved 
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towards the camera to effect an order, the user can be 
prompted to further manipulate the object to specify delivery 
options (e.g., rotate left for overnight mail, rotate right for 
regular mail). If the object is moved away from the camera 

5 to request product information, the user can be promoted to 
further manipulate the object to specify the type of infor- 
mation desired (e.g., rotate left for recipes, rotate right for 
FDA nutritional information, move up for information on 
other products in this family, move down to send an email 

10 to the product manufacturer). 

Credit card or other customer billing information, 
together with mailing address information, can be stored in 
a profile on the Bedoop system, and relayed to the transac- 
tional website either automatically when a purchase action is 

is invoked, or after the user afiSrms that such information 
should be sent (which affirmation may be signaled by 
manipulation of the packaging or advertisement in one of the 
earlier-described modes). Other modes of payment can 
naturally be employed. (One such alternative is the first-to- 

20 redeem electronic money system described in the present 
assignee's patent application No. 60/134,782.) 
Clothing 

In accordance with another aspect of the invention, cloth- 
ing can be ordered on-line by presenting to a Bedoop system 

25 a photograph from a catalog, or a garment tag or label. 
Encoded on each is product-identifying data, including a 
manufacturer ID. The Bedoop system responds by estab- 
lishing a link to a remote computer maintained by or on 
behalf of the manufacturer. In addition to relaying the 

30 product identification data to the remote computer, the 
Bedoop application also sends some or all of a clothing 
profile maintained by the user on the local computer. This 
profile can specify, e.g., the person's weight, height, shoe 
size, waist size, inseam, etc. The remote computer can 

35 confirm availability of the identified item in the size speci- 
fied in the clothing profile, and solicit payment and shipping 
instructions. 

Computer Access Cards 
This disclosure earlier considered access cards used to 

40 gain access to secure buildings. Related principles can be 
used in conjunction with computer access. 

A driver's license, employee photo ID, or other such 
document can be presented to a Bedoop sensor on a com- 
puter. The computer recognizes the user and can take various 

45 steps in response. 

One response is to log onto a network. Another is to set 
load a user profile file by which the computer knows how to 
arrange the desktop in the user's preferred manner. By 
manipulating the Bedoop -encoded object, the user can 

50 further, vary the environment (e.g., rotate left to launch 
standard business productivity applications and software 
development applications; rotate left to launch lunchtime 
diversions — stock update, recreational games, etc.) 

Hotel rooms are increasingly providing computer ser- 

55 vices. By presenting a driver's license, a Bedoop-equipped 
computer in a hotel room can link to a remote site indicated 
by the Bedoop data, obtain preference data for that user, and 
launch applications on the hotel computer in an arrangement 
that mimics that user's familiar work computer environ - 

60 ment, 

Audio/Video Disks, Software, and Books 

Bedoop data can be conveyed by indicia or texturing on 
the surfaces of CD and DVD disks, on the labels (or 
authenticity certificates) for same, on the enclosures for 
65 same (e.g., jewel box, plastic case, etc.), on book dust 
jackets, on book pages, etc. Any of these objects can be 
presented to a Bedoop device to establish a link to a related 
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web site. The consumer can then manipulate the object (or 
otherwise choose) to select different options. 

For music, one option is to receive MP3 or other clips of 
songs by the same artist on other CDs, or of songs from other 
artists of the same genre. Another is to view music video 
clips featuring the same artist. Still another is to order tickets 
to upcoming concerts by that artist. In-store kiosks can 
permit tentative customers to listen to sample tracks before 
they buy. 

Similar options can be presented for video DVDs. In the 
case of video, this can include listings of other movies with 
the same director, with the same starts), etc. In the case of 
software, the options can include advisories, bug fixes, 
product updates and upgrades, etc. Naturally, the user can 
make purchases from these sites, e.g., of other music by the 
same artist, other videos with the same star, software 
upgrades, etc. 

Similar options can be accessed using Bedoop data asso- 
ciated with printed book materials. 
Ad Tracking 

Advertisers commonly use different advertisements for 
the same product or service, and employ means to track 
which ad is more effective within which demographic group. 
Bedoop can provide such functionality. 

Consider a travel service web site that is promoting 
Hawaiian vacations, Bedoop data from several advertise- 
ments can lead consumers to the site. 

Identical advertisements can be placed in several different 
magazines. Each is encoded with a different Bedoop UID. 
By monitoring the UIDs of the Bedoop inquiries to the site, 
the travel service can determine which magazines yield the 
highest consumer response (e.g., per thousand readers). 

Likewise, within a single magazine, two or more adver- 
tisements may be encoded with Bedoop data leading to the 
site — again, each with a different UID. Again, analysis of the 
UIDs used in accessing the site can indicate which adver- 
tisement was the more effective. 

The instantaneous nature of the internet links permits 
advertisers to learn how consumer responses to print adver- 
tisements vary with time-of-day, yielding information that 
may assist in making ads for certain products more effective. 

More elaborate variants and combinations of the forego- 
ing are, of course, possible, If the consumers provide per- 
sonal information in response to the ads (either by permit- 
ting access to pre-stored personal profile data, or by filling 
in web-based forms, or by manipulation of the ad (e.g., 
"please move the ad towards your Bedoop sensor if you 
drank coffee this morning")), still richer statistical data can 
be gleaned. 
Rolodex of Cards 

Bedoop-encoded business cards as detailed above can be 
accumulated and kept near a telephone or computer in a 
Rolodex-like arrangement. If a refrigerator ice-maker 
malfunctions, a homeowner can find the card for the appli- 
ance repairman used a few years ago, and present it to a 
Bedoop sensor. A link is established to the repairman's 
company (e.g., web site or via telephone). At a web site, the 
repairman may provide basic information, such as hours of 
availability, current fee schedule, etc. The homeowner may 
select an option (by card gesture or otherwise) to invoke a 
teleconference (e.g., NetMeeting) to consult about the prob- 
lem. Or the homeowner may select another option to send 
e-mail. Still a further option may permit the homeowner to 
schedule a house call on the repairman's weekly calendar. 
Still a further option may permit the homeowner to view one 
or more short videos instructing customers how to fix certain 
common appliance problems. 
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Stored Value Cards 

The earlier cited "first-to-redeem" electronic money sys- 
tem may encode Bedoop data on a card that leads to storage 
at which the random- number tokens (which represent incre- 

5 ments of money) are stored. Presenting the card to a Bedoop 
system launches an application that reads and encrypts the 
tokens and forwards the encrypted data to the clearinghouse 
computer of the corresponding bank to learn their remaining 
value. There the tokens are decrypted and checked for 

10 validity (but not redeemed). The bank computer responds to 
the Bedoop system, indicating the remaining value of the 
tokens on the card. 

For security reasons, the storage containing the random- 
number tokens should not be generally accessible. Instead, 

15 the user must provide authentication data indicating autho- 
rization to gain access to that information. This authentica- 
tion data may be a PIN code. Or the user may provide 
authentication by presenting a second Bedoop-encoded 
object, e.g., a driver's license to the Bedoop system. (Many 

20 other Bedoop systems may advantageously use, or require 
the use of, two or more Bedoop objects — either presented 
one after the other, or all at the same time. The Bedoop 
system can provide visual or audible prompts leading the 
user to present the further Bedoop object(s) as necessary. 

25 Ski Lift Tickets 

In accordance with another embodiment, ski lift tickets 
are Bedoop encoded to provide various functionality. 

For example, instead of buying a lift ticket good for a day, 
a skier may purchase a ticket good for eight lifts. This data 

30 is encoded on the ticket, and sensed by a Bedoop sensor at 
each lift. The sensors are networked to a common server that 
tracks the number of lifts actually purchased, and updates 
the number as used. The skier is informed of the number of 
rides remaining on entering or leaving the lift. Statistical 

35 data can be collected about trail usage (e.g., N% percent of 
skiers ski all day along just two lifts, etc.). 

Off the slopes, back at home, the used lift ticket may be 
presented to a Bedoop sensor to obtain current snow con- 
ditions and lift hours, or to review trail maps, or to order ski 

40 vacation packages. If the ticket is encoded with the owner's 
name, UID, or other information of commercial/marketing 
interest, local merchants may give the bearer discounts on 
selected goods in response to Bedoop scanning of the ticket 
and recovery of such information. 

45 REI Membership Cards 

Membership cards for certain stores can be Bedoop- 
encoded to provide added value to the member. For outdoor 
gear stores such as REI, presentation of the card to a Bedoop 
sensor can lead to a library of USGS maps, to web pages 

50 with current fishing and hunting regulations, etc. Naturally, 
the store's on-line ordering site is just a quick twist away. 
Theme Park Tickets 

Theme park tickets can be encoded with the age and 
gender of the visitor, and with additional data permitting the 

55 experience to be customized (e.g., from a roster of theme 
park personalities, the visitor's favorite is Indiana Jones). 
Throughout the park are kiosks to which the visitor can 
present the ticket to orchestrate the visit to follow a particu- 
lar story line. Some kiosks issue premiums matching the 

60 age/gender of the recipient. 
Car Keys 

In accordance with another embodiment of the invention, 
car keys (or key ring fobs) are Bedoop encoded. When the 
car is taken to a shop for service, the mechanic presents the 
65 key to a Bedoop sensor, and thereby obtains the car's 
maintenance history from a remote server on which it is 
maintained. At home, the key can be presented to a Bedoop 
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sensor and manipulated to navigate through a variety of Product tags can likewise be Bedoop-encoded. A tag from 

automotive-related web sites. an article of Nike apparel can lead to the Nike on-line store, 

In some embodiments, the Bedoop-encoded object is not where the user can buy more merchandise. If the tag is from 

used to navigate to a site, but is instead used to provide data a soccer jersey, a certain tag manipulation (e.g., rotate left) 

once a user's computer is otherwise linked to a web site. A 5 may lead the user to a special-interest soccer page, such as 

user surfing the web who ends up at a car valuation site can for the World Cup. A tag on a golf glove may lead to a 

present a key to the Bedoop scanner. The Bedoop data is website of a local golf course. Twist left to reserve a tee time; 

used to access a remote database where the make, model, twist right to review course maps and statistics. Bedoop 

options, etc., of the car are stored. This data is provided to kiosks can be provided in retail stores to let consumers use 

a database engine that returns to the user the estimated value the Bedoop features, 

of the car. Travel Planning Services 

While visiting a mechanic's web site, presentation (and After making a reservation at a resort, a consumer is 
optionally manipulation) of a key or key ring fob can be typically mailed (by email or conventional mail) various 
employed to schedule a service appointment for the car. confirmation information. If not already printed, the con- 
Fashion Coordination sumer can print this information (e.g., a confirmation card). 

Some department stores and clothing retailers offer "per- 15 Bedoop-encoding on the printed object can lead to web- 

sonal shoppers" to perform various services. For example, a based information relating to the reservation (e.g., reserva- 

customer who is purchasing a dress may ask a personal tion number, the consumer's name, arrival/departure dates, 

shopper for assistance in selecting shoes or accessories that etc.). If the consumer wishes to make dinner or golf 

complement the dress. reservations, this object is presented to a Bedoop system — 

A Bedoop-encoded garment tag on the dress can be 20 either at the user's home, at an airport kiosk, etc. The system 

employed to obtain similar assistance. In response to such a recognizes the object type and encoded data, and establishes 

tag, a Bedoop system can query a database to obtain a a link to a remote computer that provides various informa- 

mini-catalog of clothes and accessories that have previously tion and scheduling services for the resort. By manipulating 

been identified as complementing the dress identified by the the object (or otherwise) the consumer selects desired dinner 

tag. These items can be individually displayed on a screen 25 and golf tee times. The system already has the reservation 

associated with the system, or a virtual model wearing the number (indexed by the UID), so tedious provision of such 

dress — together with one or more of the recommended data is avoided. 

accessories — can be synthesized and depicted. The shopper In some embodiments, the remote computer is not main- 
may quickly review the look achieved by the model wearing tained by the resort, but is rather maintained by an indepen- 
the dress with various different pairs of shoes, etc., by 30 dent travel service. (The travel service may also maintain the 
repeatedly activating a user interface control (by mouse, DNS leaf node server.) The computer can present a web page 
touch screen, or garment tag gestures) to cycle through (branded by the travel service or not) that offers the sched- 
different combinations. uling options desired by the user, and also presents links to 

A shopper's credit card can be Bedoop-encoded so as to other information and services (e.g., offering entry tickets to 

lead Bedoop systems of particular stores (i.e., stores pre- 35 nearby attractions, and advertising nearby restaurants), 

authorized by the shopper) to a profile on the shopper (e.g., Airline tickets (or e-ticket confirmations) can be similarly 

containing size information, repeat purchase information, encoded with Bedoop data. These items may be presented to 

return history, style/color preferences, etc.). Bedoop systems — at a traveler's home or in airports — to 

Credit Card Purchases permit review and changing of travel itinerary, reserve hotels 

When a consumer visits a commercial web site and 40 and rental cars, secure first-class upgrades, check the air- 
wishes to purchase a displayed product, the transaction can plane's seating arrangement, review frequent flier status, 
be speeded simply by presenting a Bedoop-encoded credit scan tourist information for the destination, etc. 
card to a Bedoop sensor on the user's computer. The Bedoop Movie Tickets 

data on the card leads to a database entry containing the As indicated earlier, movie tickets can be encoded with 

credit card number and expiration date. The Bedoop appli- 45 Bedoop data identifying, e.g., the movie title and date. When 

cation then sends this information (optionally after encrypt- a movie viewer returns home, the ticket stub can be pre- 

ing same) to the web site with instructions to purchase the sented to a Bedoop system. One of the options presented by 

depicted product. the corresponding Bedoop application can be to launch a 

(Impulse purchases are commonly deterred by the hurdles pay-per-view screening of the just-seen movie at a dis- 
posed between the purchase impulse and the completed 50 counted rate. Another is to download the movie onto a 
purchase. This and other Bedoop applications aid in reduc- writeable DVD disk at the viewer's home, perhaps serialized 
ing such hurdles.) to permit playback only on that viewer's DVD player, or 
Product Marketing enabled for only a few playbacks, etc. (again, likely for a 

Bedoop data relating to one product or service can be used discounted fee). Still another option is to present web- 
to cross-market others products and services. Consider a 55 delivered video clips from the movie. Another is to offer 
consumer who purchases a pair of golf shoes. The box is related merchandise for purchase, possibly at discount to 
Bedoop encoded. By presenting the box to a Bedoop system, retail. (These features may be available for only a limited 
the consumer is linked to a web page that presents various period after the date encoded on the ticket stub.) Another is 
promotional offers. The consumer may, for example, elect to to alert the consumer to upcoming movies of the same 
play a free round of golf at one or more identified local golf 60 genres, or with the same director or stars, or released by the 
courses, or print a coupon for ten percent off any order of same studio. Still another is to direct a web browser to an 
socks from an on-line sock merchant. (Various means can be on-line ticket merchant for tickets to other movies. The 
employed to prevent multiple redemptions from a single consumer may navigate among these options by manipulat- 
box. One is a serial number that is tracked by the web page ing the ticket stub, or otherwise. 

or cross-marketed merchant, and only honored once. 65 The same, or related, options can likewise be provided in 

Another is identification data corresponding to the consumer response to Bedoop data detected from a book jacket pre- 

that is tracked to prevent multiple redemptions.) sented to a Bedoop system. 
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Video Recording 

A video recording device can be programmed to record a 
broadcast program by presenting a Bedoop sensor with a 
printed promotion for the program (e.g., an advertisement in 
a newspaper or TV Guide). Bedoop-encoded within the 
printed document is data by which the Bedoop system 
(which may be built into the video recorder or separate) can 
set the recording time, date, and channel. 
Set Top Boxes 

Many entertainment-related applications of Bedoop data 
can be implemented using television set top boxes. Such 
boxes include processors, and typically include a return 
channel to a control facility. The provision of a Bedoop chip 
and optical sensor can vastly increase the functionality these 
devices presently provide. 
Special Event Tickets 

Consider a ticket to a basketball game. By presenting the 
ticket to a Bedoop system, a user may access the web site of 
either team so as to review recent scores and statistics. The 
user may also obtain a web -based virtual tour of the arena, 
and review seating maps. Tickets for upcoming games may 
be ordered, as well as pay-per-view games and team sou- 
venirs. For high-priced tickets, the user may be entitled to 
premium web features, such as on-line text-, audio-, or 
video-chat session with a team star on the day before the 
game. 

Unlike conventional tickets, Bedoop-encoded tickets 
need not limit the user to a predetermined seat. While the 
ticket may be printed with a nominal seat, the user may 
present the ticket to a Bedoop sensor and access a web site 
at which a different seat can be reserved. On attending the 
event, the consumer presents the ticket to a Bedoop sensor 
that reads the ticket UID and looks up the seat assignment 
most-recently picked by the consumer. It then prints a chit 
entitling the consumer to take the seat earlier selected from 
the transactional web site. 
Signet Rings 

Signet rings have historically been used to indicate a 
person's identity or office. Such rings, or other items of 
personal jewelry, can be encoded with Bedoop data (either 
by texturing or printing) and presented as necessary to 
Bedoop systems. The extracted Bedoop data can lead to a 
secure web site indicating the person's name and other 
information (i.e., a web site that has anti-hacking measures 
to prevent illicit change of the stored identification 
information). Such a signet ring can be presented to Bedoop 
systems that require a high-confidence confirmation of 
identity/authorization before proceeding with a Bedoop 
function. 
Post-It® Notes 

Pads of Post-It® notes, or other pads of paper, can be 
marked by the manufacturer (either by texturing, water- 
marked tinting, ink-jet spattering, etc.) to convey stegano- 
graphic data (e.g., Bedoop data). When such a note is 
presented to a Bedoop system, the system may launch an 
application that stores a snapshot of the note. More 
particularly, the application may mask the note-portion of 
the image data from the other image data, virtually re- map 
it to a rectangular format of standardized pixel dimensions, 
JPEG-compress the resulting image, and store it in a par- 
ticular computer subdirectory with a name indicating the 
date of image acquisition, together with the color and/or size 
of the note, (These latter two data may be indicated by data 
included in the Bedoop pay load.) If the color of the note is 
indicated by digital data (e.g., in the file name), then the 
image itself may be stored in grey-scale. When later recalled 
for display, the white image background can be flooded with 
color in accordance with the digital color data. 
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The Bedoop system may buffer several past frames of 
image data. When the object is recognized as a Post-It note 
whose image is to be saved, the system may analyze several 
such frames to identify the one best -suited for storage (e.g., 
5 check the spatial frequency content of the note as imaged in 
each frame, to identify the one with the finest detail), and 
store that one. 

When a Post-It note is recognized by the Bedoop system, 
the system may emit a confirmation tone (or other response) 
10 to indicate that the object has been recognized, but not 
immediately execute the snapshot operation. Instead, the 
system may await a further instruction (e.g., gesture) to 
indicate what operation is desired. 

By moving the note towards the sensor, for example, the 
15 user can signal that a snapshot operation is to be performed. 
(This closer presentation of the note may also permit the 
imaging system to capture a more detailed frame of image 
data.) 

By moving the note away, the system may respond by 
20 reading, decompressing, and displaying the six most- 
recently stored Post-It note images, in tiled fashion, on the 
computer screen. The individual notes can be displayed at 
their original dimensions, or each can be resized to fill the 
full height or width of a tile. A user interface control 
25 (responsive to gestures, mouse operation, keyboard scroll 
arrows, etc.) allows the user to scroll back in time to any 
desired date. 

The full 64-bit Bedoop payload of other embodiments 
may not be needed for Post-It notes. In the just -given 

30 example, for example, the Bedoop system responds to all 
Post-It notes in the same fashion. Thus, an abbreviated 
Bedoop format that indicates simply 'I'm a Post-It note, 
yellow, size 3"x3 m can suffice. The twelve bit CLASS ID, 
with eight further bits to indicate color/size combinations, 

35 may be sufficient. Reducing the payload permits it to be 
more robustly encoded on small objects. (As noted below, 
Bedoop decoding systems can look for several different data 
formats/protocols in trying to extract Bedoop data from an 
object.) 

40 Alignment of Documents for Other Purposes 

While the just-described pre-marked paper triggered a 
Bedoop response when presented to a Bedoop sensor (i.e., 
take a snapshot of the paper), the markings can be used for 
purposes other than to trigger Bedoop responses. 

45 Regardless of the particular data with which the paper is 
encoded, the embedded subliminal graticules, or other 
steganographically-encoded registration data, can be used 
by other applications to correct misalignment of scanned 
data. In a photocopier, for example, a document need not be 

50 placed exactly squarely on the glass platen in order to yield 
a properly- aligned photocopy. The scanner scans the skewed 
document and then detects the steganographic registration 
markings in the resulting scan data. This data is then 
processed to virtually re- register same, so that the registra- 

55 tion markings are in a desired alignment. The processed scan 
data is then provided to the xerographic reproduction unit to 
yield a photocopy in which the skew effect is removed. 

The same technique is likewise applicable to video 
recorders, digital cameras, etc. If such a device images an 

60 object (e.g., a photograph) with steganographic registration 
markings, these markings can be used as a guide in 
re-registering the resulting data to remove mis- alignment 
effects. 

Postal Mail Information 
65 Many contexts arise in which data to be presented to a 
consumer is valuable only if timely. The postal service mail 
is ill-suited for some such information due to the latency 
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between printing a document, and its ultimate delivery to a components of certain computers (e.g., the Sony Vaio 
recipient. Bedoop principles, however, allow the recipient to laptops) is just one manifestation of this trend. Another is 
take a postal object that was printed well before delivery, camera-on-a-chip systems, as typified by U.S. Pat. No. 
and use it on receipt (i.e., present to a Bedoop system) to 5,841,126 and detailed in Nixon et al., "256x256 CMOS 
receive up-to-the-minute information. In this and other 5 Active Pixel Sensor Camera-on-a-Chip," IEEE J. Solid- 
embodiments, the Bedoop data can also uniquely identify State circuits, Vol. 31(12), pp. 2046-2051 (1996), and 
the addressee/recipient/user, so the web site can present data possum, "CMOS Image Sensors: Electronic Camera-on-a- 
customized to that user. . chip/' IEEE Transactions of Electron Devices, vol. 44, No. 

Distributors of printed advertising can reward Bedoop- 0ct w ig97 Stm anothe r is head-mounted cameras (as are 

driven consumer visits to then -web sites by issuing digital u used . some compuler . augmented ; ision 

tokens or coupons that can be redeemed for premiums, r t s ' ™ , . r . . ° , . 

cash-back, etc Every millionth visitor wins a million pen- s y ste ™ s) - These . a " d ° ther image inpul devices are a11 

nies (with appropriate safeguards, e.g., preventing more than sul ' able for ™* m u Bedoo P s y stems ' . J . L 

one entry an hour) Camera-on-a-cnip systems can be equipped with Bedoop 

Classes of Bedoop Encoding detector hardware integrated on the same chip substrate. 

The above-described embodiments focused on use of 15 hardware can be arranged to find and decode Bedoop 

Bedoop data after decoding. Additional insight may be data from tne ima S e data— notwithstanding scale, rotation, 

gained by examining the earlier part of the process — differential scaling, etc. Gestural decoding can also be 

encoding. provided in hardware, with the resulting data output in 

Encoding can be performed in many contexts, which may packet form on a serial output bus. Such a chip can thus 

be conceptualized as falling into three broad classes. The 20 provide several outputs — image data (either in raw pixel 

first is static marking, in which a document designer, pre- form, or in a data stream representing the image in one of 

press service bureau, advertising agency or the like embeds various image formats), 64 bits of Bedoop data (serially or 

Bedoop data. The second is dynamic marking, in which in parallel), and decoded gesture data, 

automated systems encode, or vary, Bedoop data "on the In other embodiments, the Bedoop detector (and/or the 

fly." Such systems can tailor the Bedoop data to particularly 25 gestural decoder) can be on a substrate separate from the 

suit the context, e.g., to the moment, place, user, etc. The camera system. 

third is consumer marking, in which Bedoop data is added To accommodate different Bedoop data formats and 

to a document at the time of printing. protocols, the hardware can include RAM or ROM in which 

The second class of encoding enables features not avail- different format/protocol information is stored. (These dif- 

able from the first. Consider an American Express travel web 30 ferent formats/protocols can relate, e.g., to Bedoop systems 

page with information about travel to Hawaii. A DNS leaf employing different data payload lengths, different sublimi- 

node server points to this page in response to certain Bedoop nal grids, different encoding techniques, etc.) As the Bedoop 

data — e.g., data encoded in a magazine photograph of a system stares out and grabs/analyzes frames, each frame can 

Hawaiian beach scene. be analyzed in accordance with several different formats/ 

Actually, all Bedoop data having a certain CLASS and 35 protocols to try and find a format/protocol that yields valid 

DNS ID may lead to this web page, irrespective of the UID Bedoop output data, 

data. If the magazine photo is encoded with a particular Movable Bedoop Sensors 

"don't care" UID field(e.g., 111111111111111111111111), Although the illustrated Bedoop systems are generally 

this may signal the originating Bedoop system — or any stationary, they need not be so. They can be portable. Some 

intervening system through which the Bedoop data passes — 40 such systems, for example, employ palmtop computers 

that arbitrary data can be inserted in the UID field of that equipped with optical sensor arrays. If the palmtop is 

Bedoop packet. The originating Bedoop system, for provided with live network connectivity (e.g., by wireless), 

example, can insert a dynamically-configured series of bits then Bedoop applications that rely on remote computers can 

into this field. Some of these bits can provide a profile of the be implemented just as described. If the palmtop is not 

user to the remote server, so that the Bedoop response can 45 equipped with live network connectivity, any Bedoop appli- 

be customized to the user. (The user would naturally pre- cations that rely on remote computers can simply queue such 

approve information for such use so as to allay privacy communications, and dispatch same when the palmtop next 

concerns.) has remote access (e.g., when the palmtop is next placed in 

As one example, the local Bedoop system can set the least its recharger and is coupled to a modem through which 

significant bit of the UID field to a "0" if the user is male, 50 internet access can be established), 

or to a "1" if the user is female. The next four bits can Another variant is a Bedoop sensor that is movable 

indicate the user's age by one of sixteen age ranges (e.g., 3 around a desk or other work-surface, like a mouse. Such a 

or less, 4-5, 6-7, 8-9, 10-11, 12-13, 14-15, 16-17, 18-20, sensor can be coupled to the associated computer by cabling, 

21-24, etc.). or a wireless interface can be used. The peripheral may be 

Alternatively, or in addition, the local Bedoop system can 55 arranged for placement on top of an item in order to read 

stuff the don't-care UID field (all of it, or in part) with digital data with which the object is marked. (Built-in 

signature data tending to uniquely identify the local Bedoop illumination may be needed, since the device would likely 

system (e.g., system serial number, a hash code based on shadow the encoding.) Some forms of such peripherals are 

unchanging data unique to that system, etc.) By reference to adapted to serve both as general purpose digital cameras, 

such data, the remote server can identify repeat visits by the 60 and also as Bedoop sensors. 

same user, and can tailor its responses accordingly (e.g., by Such a peripheral would find many applications. In "read- 
recalling a profile of information earlier entered by the user ing" a magazine or book, for example, it may be more 
and stored at the remote server, avoiding the need for data intuitive to place a Bedoop reader "on" the object being 
re-entry). read, rather than holding the object in the air, in front of a 
More on Optical Input Devices 65 Bedoop sensor. This is particularly useful, e.g., when a 
It is expected that image input devices will soon become magazine page or the like may have several differently- 
commonplace. The provision of digital cameras as built-in encoded Bedoop sections (corresponding to different 
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articles, advertisements, etc.), and the user wants to assure 
that the desired Bedoop -encoded section is read. 

The "bookmark" paradigm of internet browsers might be 
supplemented with paper bookmarks, e.g., Bedoop data 
encoded on one or more pages of paper. To direct a browser 5 
to a particular bookmarked destination, the peripheral is 
simply placed on top of the page (or part thereof) that is 
marked with the corresponding Bedoop data. A user may 
print a "map" comprised of postage stamp-sized regions 
tiled together, each of which regions represents a favorite 
web destination. 

Such a map may be printed on a mouse pad. Indeed, 
mouse pads with certain maps pre-encoded thereon may be 
suitable as promotional materials. A company may offer to 
print a family photograph on such a pad. Encoded within the 
photograph or the pad texture are addresses of web sites that 15 
have paid a fee to be accessible in this manner on a user's 
desk. Like mice — which are provided with buttons, roller 
wheels, and roller buttons in addition to X-Y encoders — 
movable Bedoop encoders can likewise be provided with 
auxiliary switches and roller inputs to complement the data 20 
input provided by the optical sensor. Indeed, some embodi- 
ments integrate the functions of Bedoop peripheral with a 
mouse. (The undersides of mice are generally under-utilized, 
and can readily be equipped with an image sensor.) 

Gestural input can readily be provided by such a 25 
peripheral — in this context moving the sensor rather than the 
object. 

Watermarking Techniques 

There are nearly as many techniques for digital water- 
marking (steganographic data encoding) as there are appli- 30 
cations for it. The reader is presumed to be familiar with the 
great variety of methods. A few are reviewed below. 

The present assignee's prior application Ser. No. 09/127, 
502, filed Jul. 31, 1998, now U.S. Pat. No. 6,345,104, shows 
techniques by which very fine lines can be printed on a 35 
medium to slightly change the medium's apparent tint, while 
also conveying digital data. Commonly-owned application 
Ser. No. 09/074,034, filed May 6, 1998, now U.S. Pat. No. 
6,449,377, details how the contours of printed imagery can 
be adjusted to convey digital data. (That technique can be 40 
applied to printed text characters, as well as the line art 
imagery particularly considered.) The assignee's U.S. Pat. 
No. 5,850,481 details how the surface of paper or other 
media can be textured to convey optically-detectable binary 
data. The assignee's U.S. Pat. Nos. 5,841,886 and 5,809,160 45 
detail various techniques for steganographically encoding 
photographs and other imagery. 

Some watermarking techniques are based on changes 
made in the spatial domain; others are based on changes 
made in transformed domains (e.g., DCT, wavelet). Water- so 
marking of printed text can be achieved by slight variations 
to character shape, character kerning, line spacing, etc. 

Data glyph technology, as detailed in various patents to 
Xerox, is usable in many of the applications detailed herein. 

The foregoing is just a gross under-sampling of the large 55 
number of watermarking techniques. The artisan is pre- 
sumed to be familiar with such art, all of which is generally 
suitable for use in the applications detailed herein. 

More generally, essentially any data encoding method that 
permits recovery of the encoded data from optical scan data 60 
can be employed. Bar codes (ID and 2D) are but the most 
familiar of many such optically^detectable data encoding 
techniques. 
Conclusion 

Having described and illustrated the principles of our 65 
invention with reference to illustrative embodiments, it 
should be recognized that the invention is not so limited. 
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For example, while certain of the embodiments were 
illustrated with reference to internet-based systems, the 
same techniques are similarly applicable to any other 
computer-based system. These include non-internet based 
services such as America Online and Compuserve, dial-up 
bulletin board systems, etc. Likewise, for internet-based 
embodiments, the use of web browsers and web pages is not 
essential; other digital navigation devices and other on-line 
data repositories can be similarly accessed. 

Similarly, while the details of the preferred Bedoop sys- 
tem were particularly given, the underlying principles can be 
employed in numerous other forms. 

For example, one other form is to steganographically 
encode physical objects with Digital Object Identifiers 
(DOIs). The Center for National Research Initiatives and the 
Digital Object Identifier Foundation (www.doi.org) have 
performed extensive work in establishing an infrastructure 
by which digital objects can be distributed, tracked, and 
managed. Some of this same infrastructure and technology 
can be adapted, in accordance with the teachings provided 
above, to associate new functionality with physical objects. 

Another form is not to reference a remote data repository 
by data embedded on an object, but instead to encode the 
ultimate data directly on the object. A photograph, for 
example, can be literally encoded with a telephone number. 
On presenting the photograph to an optical sensor on the 
telephone, the telephone can analyze the optical information 
to extract the telephone number, and dial the number, 
without the need for any external data. Similarly, a printed 
office document (e.g., spreadsheet) can be encoded with the 
path and file name of the corresponding electronic file, 
obviating the need for indirect linking (e.g., to a database to 
correlate a UID to a computer address). Most of the above - 
described embodiments are suitable for such direct encoding 
of the related data. 

In the business card example given above, the detailed 
techniques can be supplementary to existing optical charac- 
ter recognition techniques. That is, the image data from an 
optical sensor can be applied both to a Bedoop decoder and 
to an OCR system. Text characters discerned by the OCR 
system can be entered directly into a contacts manager 
personal database. The techniques employed in the Bedoop 
system to locate the encoded object and handle visual 
distortion (e.g., the visual artifacts due to scale, rotation, 
etc.) can advantageously be used in OCR detection as well, 
permitting extraction of the OCR information without care- 
ful placement of the card. 

While certain of the foregoing embodiments made refer- 
ence to ink-jet printing, similar advantages can often be 
obtained with other printing technologies, e.g., laser/ 
xerographic printing, offset printing, etc. 

In the foregoing embodiments, Bedoop decoding gener- 
ally proceeded from image data obtained from a physical 
object. However, in some contexts, it is advantageous to 
Bedoop-decode image data provided electronically, e.g., 
over the internet. 

Likewise, while the foregoing embodiments generally 
relied on Bedoop image sensors that stared out for an object 
at an expected point, in alternative embodiments, sensors 
that seek rather than stare can be employed (as was illus- 
trated above in connection with the elevator example) 

Similarly, while the illustrated embodiments generally 
employed sensors that repeatedly grabbed frames of image 
data, this need not be the case. Single frame systems, such 
as flatbed scanners, and video systems arranged to grab 
single frames — with or without TWAIN interfaces — can 
alternatively be used. 
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As indicated above, while steganographic encoding of the great wealth of new functionality, now accessible through 

digital data is used in the preferred embodiments, visible familiar paper items, rather than through a "computer input 

forms of digital encoding — such as bar codes — can naturally peripheral." 

be employed where aesthetic considerations permit. To provide a comprehensive disclosure without unduly 

In certain of the embodiments, digital data conveyed by 5 lengthening this specification, applicant incorporates by 

means other than optical can be used. Electromagnetic reference the patents, applications, and publications identi- 

detection (e.g., of the sort used in proximity-based card- fled above. 

access systems) can be arranged to decode digital data, In view of the many embodiments to which the principles 

permitting "at-a-distance" reading of data from physical of my invention may be applied, it should be recognized that 

objects, just as in the foregoing embodiments. to the detailed embodiments are illustrative only and should 

Since the Bedoop image sensors typically acquire plural not be taken as limiting the scope of my invention. Rather, 

frames of data, the extraction of the digital data can be based I claim as my invention all such embodiments as fall within 

on more than a single image frame. More confidence in the the scope and spirit of the following claims, and equivalents 

results may be accumulating decoded data over several thereto, 

frames. Moreover, movement of the object within the sen- 15 I claim: 

sor's field of view may permit the system to acquire infor- 1. A method of initiating access to a computer via a data 

mation from other perspectives, etc., enhancing system communications medium, the method comprising: 

operation. receiving artwork corresponding to an object to be 

While the preferred embodiments employ 2-D image printed, the artwork including text and background; 
sensors (e.g., CCDs), other optical sensing technology can 20 steganographically embedding into a region of said back- 
alternatively be employed. Supermarket laser scanners, for ^ havin substantiaUy non-uniform pixel values 
example, can read bar-code data. Raster-scanning of such certain information indicative of an address associated 
systems can permit acquisition of 2-D data (either in bit- wilh &aid computer; and 

ma «S e ^ ^?u m, *i? r ? fe / j ° a ^L j • t j < /*> a f% a i_ *» „ printing said object using the artwork into which said 

While the illustrated embodiments used a 12/24/24 bit 25 - r u u f u- n u jj j 

if i-i a co /t*\ vto n ttt*^ j * *i~ * information has been steganographically embedded, 

protocol for CLASS/DNS/UID data, other arrangements can - A , . , 4 . t r * t , , • , ,- 

r - . . . i • . • . j 2. A physical object printed on a substrate and including 

of course be used. In some applications it is advantageous t . j u i j . i **uut j u - 

r »u i . i . i_ .l. i j text and background, at least the background having a 

for the protocol to more nearly match those commonly used , , , & t .. „ , T, . • ., 

f • . . • t- t m jj c plural-bit code steganographically embedded therein, said 

for internet communications. For example, IP addresses for a u ■ • j * j ♦ . *, .u ♦ -a aa 

internet Domain Name Servers (DNS) are presently 32 bits, 30 ?°* an f mdex to a , data s,ructu " ' *V s ^f cs addr f^ 

... „ , --of.-* r * c . information of a computer resource that is to be associated 

with extension to 64 or 128 bits foreseen in the near future. ... ,. . . . . t c , , 

t-u t^ktc- & 1 j * t» j . , 4t . , . with said object, wherein at least a portion or said back- 

standard * P ^ ground has substantial ly non-uniform pixel values, and has 

j . i i . ^ sa id plural-bit code steganographically embedded therein. 

Some embodiments can advantageously employ texture- iVu u- * * i ■ f -jj* 

. i • r u- ♦ j 4 i. • . „ 3. The object of claim 2 wherein said data structure is 

based Bedoop encoding of objects. Bedoop texturing can be 35 . . . , J . . c 

- tJL r . . , j. 11 i_ • maintained on a computer separate from the computer 

effected by various means, including pressure rollers, chemi- , . c ... • * j ^ tL 

. . J 4 . . t tor whose address information is to be associated with the 

cal or laser etching, etc. . . 

While the foregoing embodiments have generally >i A * *u j r • •** , j . 

1 j i u- . 7 ■ « • • » & ,. ./ 4. A method or initiating access to a computer via a data 

employed planar objects to convey the digital encoding, this . # . , r . - 

a . u a. i^u- * r i u i'i ■ u communications medium, the method comprising: 

need not be the case. Objects of other shapes can likewise be 40 . . . - 

employed. Some shapes present relatively straightforward creatlD g a data ob J ect Wlth formation mdicative of an 

image processing tasks. Data imaged from a soft drink can address associated with the computer, 

or other cylindrical surface, for example, is fairly easy to steganographically embedding the data object in a second 

remap using known geometrical transforms so as to essen- ob j ect comprising at least one of audio and visual data, 

tially "unwrap" the printing from the can. Other geometries 45 said embedding occurring in-band within said audio or 

can present more complex re-mappings, but are likewise data, rather than in a part of said second object 

generally within the capabilities of the artisan. (Such remap- DOt intended for presentation to a user; 

ping is facilitated by encoding in the data certain reference decoding from the second object the steganographically 

markings, such as subliminal graticules, etc. The unknown embedded data object; and 

3D shape of the object being imaged can usually be inferred 50 initiating a link to the computer using the address in the 

from the apparent warping of the reference markings in the decoded data object. 

2D image data generated by the scanner. Once the warping 5. The method of claim 4 wherein the address in the 

is characterized, it is generally straightforward to un-warp so steganographically embedded data object is a URL address, 

as to prepare the image data for decoding.) 6. The method of claim 4 wherein the steganographically 

It was once popular to predict that paper documents 55 embedded data object includes an index number for use in 

would be replaced with electronic media. In hindsight, accessing a data base. 

electronic media may be recognized as a poor surrogate for 7. The method of claim 4 that includes performing said 

paper. Electronic media conveys information flawlessly, but decoding and initiating in the same device. 

is lacking in experiential attributes. We can hold paper, stack 8. The method of claim 4 in which the second object is in 

it, own it, deface it, give it, guard it, etc. It provides an 60 digital form, and is not rendered into human-perceptible 

opportunity for physical dominion entirely lacking with form between said embedding and decoding. 

electronic media. 9. The method of claim 4 in which the second object 

From the foregoing discussion it can be seen that, rather comprises digital audio data, 

than replacing paper with electronic media, perhaps the 10. The method of claim 4 in which the second object 

future lies in giving paper digital attributes — hybridizing the 65 comprises digital image data. 

physical experience of paper with the technical advantages 11. The method of claim 4 in which the second object 

of digital media. Such an arrangement makes available a comprises video data. 
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12. The method of claim 4 that includes distributing the 
object to at least certain members of the public between said 
embedding and decoding. 

13. The method of claim 4 in which said second object is 
originally in digital form when steganographically 
embedded, but is thereafter rendered into human-perceptible 
form, converted back into digital form, and decoded, 
wherein said rendering into human-perceptible form, and 
subsequent conversion back into digital form, does not 
prevent decoding of the steganographically embedded data 
object. 

14. A method of initiating access to a computer via a data 
communications medium, the method comprising: 

creating a data object with information indicative of an 
address associated with the computer; 

steganographically embedding the data object in a second 
object comprising at least one of audio and visual data, 
said embedding extending generally throughout a 
sampled representation of said second object, rather 
than localized in a particular portion thereof, wherein 
the complete data object can be recovered from an 
excerpt of said second object and used to initiate a link 
to the computer. 

15. The method of claim 14 in which the second object is 
represented by plural samples when in digital form, and said 
embedding changes a majority of said samples. 
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16. The method of claim 14 in which the second object is 
represented by plural samples when in digital form, and the 
embedding is relatively weaker in regions of relatively 
uniform samples. 

17. A method of initiating access to a computer via a data 
communications medium, the method comprising: 

receiving data corresponding to an audio object, said 
object comprising audio data and having information 
indicative of an address associated with the computer 
steganographically embedded in-band within said 
audio data; 

decoding the information from said audio object; and 
15 initiating a link to the computer using said information. 

18. The method of claim 17 in which said receiving 
comprises receiving said object data from a digital storage or 
transmission medium in digital form, without said object 

20 having being rendered into human-perceptible form since 
being steganographically embedded. 

19. Hie method of claim 17 in which said receiving 
comprises sensing a human-perceptible form of said audio 
object, as by a microphone, and converting into digital form. 
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